Wiki

Version 25 (Etienne Pallier, 03/18/2016 10:34 am)

1 1 Etienne Pallier
h1. Technical Documentation for the PYROS project (FGFT-CC)
2 1 Etienne Pallier
3 1 Etienne Pallier
4 1 Etienne Pallier
HOWTO Format Redmine Wiki : http://www.redmine.org/projects/redmine/wiki/FrRedmineWikiFormatting
5 1 Etienne Pallier
6 1 Etienne Pallier
{{>toc}}
7 1 Etienne Pallier
8 1 Etienne Pallier
9 1 Etienne Pallier
10 3 Etienne Pallier
---
11 1 Etienne Pallier
12 17 Etienne Pallier
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}I - INSTALLATION%
13 2 Etienne Pallier
14 2 Etienne Pallier
15 1 Etienne Pallier
16 6 Etienne Pallier
h3. Create database
17 1 Etienne Pallier
18 3 Etienne Pallier
One liner:
19 3 Etienne Pallier
$ mysql -u root < pyros.sql
20 1 Etienne Pallier
21 3 Etienne Pallier
Or :
22 3 Etienne Pallier
$ mysql -u root
23 3 Etienne Pallier
mysql> create database pyros;
24 3 Etienne Pallier
mysql> use pyros;
25 3 Etienne Pallier
mysql> source pyros.sql;
26 1 Etienne Pallier
27 3 Etienne Pallier
(
28 3 Etienne Pallier
TODO:
29 3 Etienne Pallier
mysql> grant all on pyros.* to pyros@localhost identified by ‘pyros’;)
30 3 Etienne Pallier
mysql> flush privileges;
31 3 Etienne Pallier
)
32 1 Etienne Pallier
33 1 Etienne Pallier
34 1 Etienne Pallier
35 4 Etienne Pallier
---
36 5 Etienne Pallier
37 6 Etienne Pallier
h3. Install python3.5
38 1 Etienne Pallier
39 11 Etienne Pallier
40 11 Etienne Pallier
 * Mac OS X :
41 23 Etienne Pallier
<pre>
42 24 Etienne Pallier
1) Installer MacPort
43 24 Etienne Pallier
(TODO: doc)
44 24 Etienne Pallier
45 24 Etienne Pallier
2) Installer le "port" python35
46 1 Etienne Pallier
$ sudo port install python35
47 23 Etienne Pallier
</pre>
48 1 Etienne Pallier
49 11 Etienne Pallier
 * Linux (Ubuntu) :
50 23 Etienne Pallier
<pre>
51 1 Etienne Pallier
$ sudo apt-get ...
52 23 Etienne Pallier
</pre>
53 1 Etienne Pallier
54 5 Etienne Pallier
55 3 Etienne Pallier
56 4 Etienne Pallier
---
57 5 Etienne Pallier
58 13 Etienne Pallier
h3. Create project dir
59 13 Etienne Pallier
60 13 Etienne Pallier
$ mkdir pyros
61 13 Etienne Pallier
62 13 Etienne Pallier
63 13 Etienne Pallier
---
64 13 Etienne Pallier
65 14 Etienne Pallier
h3. Create virtualenv with python3.5 dedicated to pyros project
66 3 Etienne Pallier
67 3 Etienne Pallier
$ cd pyros/
68 3 Etienne Pallier
69 3 Etienne Pallier
$ which python3.5
70 3 Etienne Pallier
/opt/local/bin/python3.5
71 3 Etienne Pallier
72 15 Etienne Pallier
$ virtualenv-3.5 venv_py35_pyros -p /opt/local/bin/python3.5
73 3 Etienne Pallier
=> creates a venv_py35_pyros/ folder inside pyros/
74 3 Etienne Pallier
75 1 Etienne Pallier
76 1 Etienne Pallier
77 7 Etienne Pallier
---
78 3 Etienne Pallier
79 16 Etienne Pallier
h3. Activate venv
80 7 Etienne Pallier
81 3 Etienne Pallier
$ source venv_py35_pyros/bin/activate
82 3 Etienne Pallier
83 3 Etienne Pallier
$ python -V
84 3 Etienne Pallier
Python 3.5.1
85 3 Etienne Pallier
86 3 Etienne Pallier
$ which pip
87 1 Etienne Pallier
…/pyros/venv_py35_pyros/bin/pip
88 16 Etienne Pallier
89 18 Etienne Pallier
Upgrade pip to last version available :
90 3 Etienne Pallier
91 3 Etienne Pallier
$ pip install --upgrade pip
92 3 Etienne Pallier
Collecting pip
93 3 Etienne Pallier
  Downloading pip-8.1.1-py2.py3-none-any.whl (1.2MB)
94 3 Etienne Pallier
Installing collected packages: pip
95 3 Etienne Pallier
  Found existing installation: pip 7.1.2
96 3 Etienne Pallier
    Uninstalling pip-7.1.2:
97 3 Etienne Pallier
      Successfully uninstalled pip-7.1.2
98 1 Etienne Pallier
Successfully installed pip-8.1.1
99 18 Etienne Pallier
100 18 Etienne Pallier
h3. From within the virtual environment, install needed python packages
101 18 Etienne Pallier
102 3 Etienne Pallier
103 3 Etienne Pallier
$ pip install django
104 3 Etienne Pallier
Collecting django
105 3 Etienne Pallier
  Downloading Django-1.9.4-py2.py3-none-any.whl (6.6MB)
106 3 Etienne Pallier
Installing collected packages: django
107 3 Etienne Pallier
Successfully installed django-1.9.4
108 3 Etienne Pallier
109 3 Etienne Pallier
$ pip install django-admin-tools
110 3 Etienne Pallier
Collecting django-admin-tools
111 3 Etienne Pallier
  Downloading django_admin_tools-0.7.2-py2.py3-none-any.whl (289kB)
112 3 Etienne Pallier
Installing collected packages: django-admin-tools
113 3 Etienne Pallier
Successfully installed django-admin-tools-0.7.2
114 3 Etienne Pallier
115 21 Etienne Pallier
$ pip install django-debug-toolbar
116 21 Etienne Pallier
Collecting django-debug-toolbar
117 21 Etienne Pallier
  Downloading django_debug_toolbar-1.4-py2.py3-none-any.whl (212kB)
118 21 Etienne Pallier
Requirement already satisfied (use --upgrade to upgrade): Django>=1.7 in ./venv_py35_pyros/lib/python3.5/site-packages (from django-debug-toolbar)
119 21 Etienne Pallier
Collecting sqlparse (from django-debug-toolbar)
120 21 Etienne Pallier
  Downloading sqlparse-0.1.19.tar.gz (58kB)
121 21 Etienne Pallier
Building wheels for collected packages: sqlparse
122 21 Etienne Pallier
  Running setup.py bdist_wheel for sqlparse ... done
123 21 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/7b/d4/72/6011bb100dd5fc213164e4bbee13d4e03261dd54ce6a5de6b8
124 21 Etienne Pallier
Successfully built sqlparse
125 21 Etienne Pallier
Installing collected packages: sqlparse, django-debug-toolbar
126 21 Etienne Pallier
Successfully installed django-debug-toolbar-1.4 sqlparse-0.1.19
127 21 Etienne Pallier
128 21 Etienne Pallier
$ pip install django-extensions
129 21 Etienne Pallier
Collecting django-extensions
130 21 Etienne Pallier
  Downloading django_extensions-1.6.1-py2.py3-none-any.whl (202kB)
131 21 Etienne Pallier
Collecting six>=1.2 (from django-extensions)
132 21 Etienne Pallier
  Downloading six-1.10.0-py2.py3-none-any.whl
133 21 Etienne Pallier
Installing collected packages: six, django-extensions
134 21 Etienne Pallier
Successfully installed django-extensions-1.6.1 six-1.10.0
135 21 Etienne Pallier
136 21 Etienne Pallier
$ pip install django-suit
137 21 Etienne Pallier
Collecting django-suit
138 21 Etienne Pallier
  Downloading django-suit-0.2.18.tar.gz (587kB)
139 21 Etienne Pallier
Building wheels for collected packages: django-suit
140 1 Etienne Pallier
  Running setup.py bdist_wheel for django-suit ... done
141 1 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/12/8b/9a/e02ab0ad9229881638aa040d47d77c8f562999533811927d41
142 1 Etienne Pallier
Successfully built django-suit
143 1 Etienne Pallier
Installing collected packages: django-suit
144 1 Etienne Pallier
Successfully installed django-suit-0.2.18
145 21 Etienne Pallier
146 25 Etienne Pallier
$ pip install gunicorn
147 25 Etienne Pallier
Collecting gunicorn
148 25 Etienne Pallier
  Downloading gunicorn-19.4.5-py2.py3-none-any.whl (112kB)
149 25 Etienne Pallier
Installing collected packages: gunicorn
150 25 Etienne Pallier
Successfully installed gunicorn-19.4.5
151 21 Etienne Pallier
152 3 Etienne Pallier
$ pip install mysqlclient
153 20 Etienne Pallier
154 20 Etienne Pallier
*Under Mac OS X*:
155 21 Etienne Pallier
<pre>
156 20 Etienne Pallier
157 3 Etienne Pallier
Collecting mysqlclient
158 3 Etienne Pallier
  Downloading mysqlclient-1.3.7.tar.gz (79kB)
159 1 Etienne Pallier
Building wheels for collected packages: mysqlclient
160 22 Etienne Pallier
  Running setup.py bdist_wheel for mysqlclient ... error
161 3 Etienne Pallier
162 3 Etienne Pallier
  ----------------------------------------
163 1 Etienne Pallier
  Failed building wheel for mysqlclient
164 1 Etienne Pallier
  Running setup.py clean for mysqlclient
165 1 Etienne Pallier
Failed to build mysqlclient
166 1 Etienne Pallier
Installing collected packages: mysqlclient
167 1 Etienne Pallier
  Running setup.py install for mysqlclient ... done
168 1 Etienne Pallier
Successfully installed mysqlclient-1.3.7
169 1 Etienne Pallier
170 1 Etienne Pallier
BOUH !!!
171 1 Etienne Pallier
172 1 Etienne Pallier
$ pip install --upgrade wheel
173 1 Etienne Pallier
Collecting wheel
174 1 Etienne Pallier
  Downloading wheel-0.29.0-py2.py3-none-any.whl (66kB)
175 1 Etienne Pallier
Installing collected packages: wheel
176 1 Etienne Pallier
  Found existing installation: wheel 0.24.0
177 1 Etienne Pallier
    Uninstalling wheel-0.24.0:
178 1 Etienne Pallier
      Successfully uninstalled wheel-0.24.0
179 1 Etienne Pallier
Successfully installed wheel-0.29.0
180 1 Etienne Pallier
181 1 Etienne Pallier
$ pip uninstall mysqlclient
182 1 Etienne Pallier
183 1 Etienne Pallier
$ pip install mysqlclient
184 1 Etienne Pallier
Collecting mysqlclient
185 1 Etienne Pallier
  Using cached mysqlclient-1.3.7.tar.gz
186 1 Etienne Pallier
Building wheels for collected packages: mysqlclient
187 1 Etienne Pallier
  Running setup.py bdist_wheel for mysqlclient ... done
188 1 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/9b/06/50/d11418c26cf8f2156b13d4363b5afde8e7e75ebb8540d0228d
189 1 Etienne Pallier
Successfully built mysqlclient
190 1 Etienne Pallier
Installing collected packages: mysqlclient
191 1 Etienne Pallier
Successfully installed mysqlclient-1.3.7
192 1 Etienne Pallier
193 1 Etienne Pallier
YES !!!
194 21 Etienne Pallier
</pre>
195 1 Etienne Pallier
196 1 Etienne Pallier
197 12 Etienne Pallier
198 12 Etienne Pallier
199 12 Etienne Pallier
---
200 12 Etienne Pallier
201 12 Etienne Pallier
h3. Create project dir
202 12 Etienne Pallier
203 12 Etienne Pallier
$ mkdir pyros
204 12 Etienne Pallier
205 12 Etienne Pallier
206 12 Etienne Pallier
 
207 12 Etienne Pallier
Exemple de bonne organisation :
208 12 Etienne Pallier
209 12 Etienne Pallier
1 projet = N applis
210 12 Etienne Pallier
(mais 1 appli peut faire partie de plusieurs projets)
211 12 Etienne Pallier
212 12 Etienne Pallier
MONPROJET/
213 12 Etienne Pallier
	src/
214 12 Etienne Pallier
		monprojet/
215 12 Etienne Pallier
		appli1
216 12 Etienne Pallier
		appli2
217 12 Etienne Pallier
218 12 Etienne Pallier
		appliN
219 12 Etienne Pallier
	public/
220 12 Etienne Pallier
	private/
221 12 Etienne Pallier
		requirements.txt
222 12 Etienne Pallier
223 12 Etienne Pallier
224 12 Etienne Pallier
225 12 Etienne Pallier
---
226 12 Etienne Pallier
227 12 Etienne Pallier
h3. Set needed folders (inside pyros/)
228 12 Etienne Pallier
229 12 Etienne Pallier
$ mkdir private public
230 12 Etienne Pallier
$ mkdir public/static
231 1 Etienne Pallier
232 3 Etienne Pallier
233 7 Etienne Pallier
---
234 3 Etienne Pallier
235 7 Etienne Pallier
h3. Create django project pyros
236 7 Etienne Pallier
237 3 Etienne Pallier
$ django-admin startproject pyros
238 3 Etienne Pallier
239 3 Etienne Pallier
$ tree pyros/
240 3 Etienne Pallier
pyros/
241 3 Etienne Pallier
├── manage.py
242 3 Etienne Pallier
└── pyros
243 3 Etienne Pallier
    ├── __init__.py
244 3 Etienne Pallier
    ├── settings.py
245 3 Etienne Pallier
    ├── urls.py
246 3 Etienne Pallier
    └── wsgi.py
247 3 Etienne Pallier
248 3 Etienne Pallier
249 3 Etienne Pallier
$ mv pyros src
250 3 Etienne Pallier
251 3 Etienne Pallier
$ cd src/
252 3 Etienne Pallier
253 1 Etienne Pallier
$ ./manage.py runserver
254 3 Etienne Pallier
(ou gunicorn pyros.wsgi)
255 1 Etienne Pallier
==> http://localhost:8000
256 1 Etienne Pallier
257 3 Etienne Pallier
258 3 Etienne Pallier
259 7 Etienne Pallier
---
260 3 Etienne Pallier
261 7 Etienne Pallier
h3. Set Database mysql
262 7 Etienne Pallier
263 3 Etienne Pallier
Edit src/pyros/settings.py
264 3 Etienne Pallier
265 3 Etienne Pallier
DATABASES = {
266 3 Etienne Pallier
    'default': {
267 3 Etienne Pallier
        'ENGINE': 'django.db.backends.mysql',
268 1 Etienne Pallier
        'NAME': 'pyros',
269 3 Etienne Pallier
        'USER': 'root',
270 1 Etienne Pallier
        'PASSWORD': ''
271 1 Etienne Pallier
    }
272 3 Etienne Pallier
}
273 3 Etienne Pallier
274 3 Etienne Pallier
275 7 Etienne Pallier
---
276 3 Etienne Pallier
277 7 Etienne Pallier
h3. Import database into django
278 7 Etienne Pallier
279 3 Etienne Pallier
cd src/
280 3 Etienne Pallier
281 3 Etienne Pallier
$ ./manage.py inspectdb > models.py
282 3 Etienne Pallier
283 3 Etienne Pallier
Traceback (most recent call last):
284 3 Etienne Pallier
  File "/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/django/db/backends/mysql/base.py", line 25, in <module>
285 3 Etienne Pallier
    import MySQLdb as Database
286 3 Etienne Pallier
  File "/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/MySQLdb/__init__.py", line 19, in <module>
287 3 Etienne Pallier
    import _mysql
288 3 Etienne Pallier
ImportError: dlopen(/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so, 2): Library not loaded: libmysqlclient.18.dylib
289 3 Etienne Pallier
  Referenced from: /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
290 3 Etienne Pallier
  Reason: image not found
291 3 Etienne Pallier
292 3 Etienne Pallier
=> BOUH !!!
293 3 Etienne Pallier
294 3 Etienne Pallier
LA SOLUTION EST ICI : http://stackoverflow.com/questions/6383310/python-mysqldb-library-not-loaded-libmysqlclient-18-dylib
295 3 Etienne Pallier
296 3 Etienne Pallier
(
297 3 Etienne Pallier
Apparemment, ceci aurait dû suffire:
298 3 Etienne Pallier
mkdir -p /usr/local/lib   
299 3 Etienne Pallier
ln -s /usr/local/mysql/lib/libmysql* /usr/local/lib
300 3 Etienne Pallier
)
301 3 Etienne Pallier
302 3 Etienne Pallier
303 3 Etienne Pallier
Mais j’ai fait ceci:
304 3 Etienne Pallier
305 3 Etienne Pallier
$ otool -L /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
306 3 Etienne Pallier
/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so:
307 1 Etienne Pallier
	libmysqlclient.18.dylib (compatibility version 18.0.0, current version 18.0.0)
308 10 Etienne Pallier
...
309 3 Etienne Pallier
310 3 Etienne Pallier
$ locate libmysqlclient.18.dylib
311 3 Etienne Pallier
/Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib
312 1 Etienne Pallier
/Library/SystemMigration/History/Migration-68137DFB-CB6A-4FBB-81E2-11BDB5D01E48/QuarantineRoot/usr/lib/libmysqlclient.18.dylib
313 1 Etienne Pallier
314 1 Etienne Pallier
$ sudo install_name_tool -change libmysqlclient.18.dylib /Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
315 1 Etienne Pallier
316 10 Etienne Pallier
$ otool -L /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
317 10 Etienne Pallier
/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so:
318 10 Etienne Pallier
	/Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib (compatibility version 18.0.0, current version 18.0.0)
319 10 Etienne Pallier
...
320 3 Etienne Pallier
321 1 Etienne Pallier
$ ./manage.py inspectdb > models.py
322 1 Etienne Pallier
323 3 Etienne Pallier
=> YES !!!
324 3 Etienne Pallier
325 3 Etienne Pallier
326 3 Etienne Pallier
327 7 Etienne Pallier
---
328 3 Etienne Pallier
329 7 Etienne Pallier
h3. Create a django application pyrosapp
330 7 Etienne Pallier
331 3 Etienne Pallier
$ ./manage.py startapp pyrosapp
332 3 Etienne Pallier
333 3 Etienne Pallier
$ tree src
334 3 Etienne Pallier
src
335 3 Etienne Pallier
├── db.sqlite3
336 3 Etienne Pallier
├── manage.py
337 3 Etienne Pallier
├── pyros
338 3 Etienne Pallier
│   ├── __init__.py
339 3 Etienne Pallier
│   ├── __pycache__
340 3 Etienne Pallier
│   │   ├── __init__.cpython-35.pyc
341 3 Etienne Pallier
│   │   ├── settings.cpython-35.pyc
342 3 Etienne Pallier
│   │   ├── urls.cpython-35.pyc
343 3 Etienne Pallier
│   │   └── wsgi.cpython-35.pyc
344 3 Etienne Pallier
│   ├── settings.py
345 3 Etienne Pallier
│   ├── urls.py
346 3 Etienne Pallier
│   └── wsgi.py
347 3 Etienne Pallier
└── pyrosapp
348 3 Etienne Pallier
    ├── __init__.py
349 1 Etienne Pallier
    ├── admin.py
350 3 Etienne Pallier
    ├── apps.py
351 1 Etienne Pallier
    ├── migrations
352 1 Etienne Pallier
    │   └── __init__.py
353 3 Etienne Pallier
    ├── models.py
354 3 Etienne Pallier
    ├── tests.py
355 3 Etienne Pallier
    └── views.py
356 1 Etienne Pallier
357 1 Etienne Pallier
358 7 Etienne Pallier
---
359 1 Etienne Pallier
360 7 Etienne Pallier
h3. Replace the default pyrosapp models.py with the inspectdb generated one
361 7 Etienne Pallier
362 3 Etienne Pallier
$ mv models.py pyrosapp/
363 3 Etienne Pallier
364 3 Etienne Pallier
365 3 Etienne Pallier
366 3 Etienne Pallier
367 7 Etienne Pallier
368 1 Etienne Pallier
---
369 9 Etienne Pallier
370 7 Etienne Pallier
*TODO*
371 7 Etienne Pallier
372 7 Etienne Pallier
h3. Fix and improve the inspectdb generated file models.py
373 3 Etienne Pallier
374 3 Etienne Pallier
$ cd pyrosapp/
375 3 Etienne Pallier
376 8 Etienne Pallier
$ vi models.py