Wiki

Version 24 (Etienne Pallier, 03/18/2016 10:33 am)

1 1 Etienne Pallier
h1. Technical Documentation for the PYROS project (FGFT-CC)
2 1 Etienne Pallier
3 1 Etienne Pallier
4 1 Etienne Pallier
HOWTO Format Redmine Wiki : http://www.redmine.org/projects/redmine/wiki/FrRedmineWikiFormatting
5 1 Etienne Pallier
6 1 Etienne Pallier
{{>toc}}
7 1 Etienne Pallier
8 1 Etienne Pallier
9 1 Etienne Pallier
10 3 Etienne Pallier
---
11 1 Etienne Pallier
12 17 Etienne Pallier
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}I - INSTALLATION%
13 2 Etienne Pallier
14 2 Etienne Pallier
15 1 Etienne Pallier
16 6 Etienne Pallier
h3. Create database
17 1 Etienne Pallier
18 3 Etienne Pallier
One liner:
19 3 Etienne Pallier
$ mysql -u root < pyros.sql
20 1 Etienne Pallier
21 3 Etienne Pallier
Or :
22 3 Etienne Pallier
$ mysql -u root
23 3 Etienne Pallier
mysql> create database pyros;
24 3 Etienne Pallier
mysql> use pyros;
25 3 Etienne Pallier
mysql> source pyros.sql;
26 1 Etienne Pallier
27 3 Etienne Pallier
(
28 3 Etienne Pallier
TODO:
29 3 Etienne Pallier
mysql> grant all on pyros.* to pyros@localhost identified by ‘pyros’;)
30 3 Etienne Pallier
mysql> flush privileges;
31 3 Etienne Pallier
)
32 1 Etienne Pallier
33 1 Etienne Pallier
34 1 Etienne Pallier
35 4 Etienne Pallier
---
36 5 Etienne Pallier
37 6 Etienne Pallier
h3. Install python3.5
38 1 Etienne Pallier
39 11 Etienne Pallier
40 11 Etienne Pallier
 * Mac OS X :
41 23 Etienne Pallier
<pre>
42 24 Etienne Pallier
1) Installer MacPort
43 24 Etienne Pallier
(TODO: doc)
44 24 Etienne Pallier
45 24 Etienne Pallier
2) Installer le "port" python35
46 1 Etienne Pallier
$ sudo port install python35
47 23 Etienne Pallier
</pre>
48 1 Etienne Pallier
49 11 Etienne Pallier
 * Linux (Ubuntu) :
50 23 Etienne Pallier
<pre>
51 1 Etienne Pallier
$ sudo apt-get ...
52 23 Etienne Pallier
</pre>
53 1 Etienne Pallier
54 5 Etienne Pallier
55 3 Etienne Pallier
56 4 Etienne Pallier
---
57 5 Etienne Pallier
58 13 Etienne Pallier
h3. Create project dir
59 13 Etienne Pallier
60 13 Etienne Pallier
$ mkdir pyros
61 13 Etienne Pallier
62 13 Etienne Pallier
63 13 Etienne Pallier
---
64 13 Etienne Pallier
65 14 Etienne Pallier
h3. Create virtualenv with python3.5 dedicated to pyros project
66 3 Etienne Pallier
67 3 Etienne Pallier
$ cd pyros/
68 3 Etienne Pallier
69 3 Etienne Pallier
$ which python3.5
70 3 Etienne Pallier
/opt/local/bin/python3.5
71 3 Etienne Pallier
72 15 Etienne Pallier
$ virtualenv-3.5 venv_py35_pyros -p /opt/local/bin/python3.5
73 3 Etienne Pallier
=> creates a venv_py35_pyros/ folder inside pyros/
74 3 Etienne Pallier
75 1 Etienne Pallier
76 1 Etienne Pallier
77 7 Etienne Pallier
---
78 3 Etienne Pallier
79 16 Etienne Pallier
h3. Activate venv
80 7 Etienne Pallier
81 3 Etienne Pallier
$ source venv_py35_pyros/bin/activate
82 3 Etienne Pallier
83 3 Etienne Pallier
$ python -V
84 3 Etienne Pallier
Python 3.5.1
85 3 Etienne Pallier
86 3 Etienne Pallier
$ which pip
87 1 Etienne Pallier
…/pyros/venv_py35_pyros/bin/pip
88 16 Etienne Pallier
89 18 Etienne Pallier
Upgrade pip to last version available :
90 3 Etienne Pallier
91 3 Etienne Pallier
$ pip install --upgrade pip
92 3 Etienne Pallier
Collecting pip
93 3 Etienne Pallier
  Downloading pip-8.1.1-py2.py3-none-any.whl (1.2MB)
94 3 Etienne Pallier
Installing collected packages: pip
95 3 Etienne Pallier
  Found existing installation: pip 7.1.2
96 3 Etienne Pallier
    Uninstalling pip-7.1.2:
97 3 Etienne Pallier
      Successfully uninstalled pip-7.1.2
98 1 Etienne Pallier
Successfully installed pip-8.1.1
99 18 Etienne Pallier
100 18 Etienne Pallier
h3. From within the virtual environment, install needed python packages
101 18 Etienne Pallier
102 3 Etienne Pallier
103 3 Etienne Pallier
$ pip install django
104 3 Etienne Pallier
Collecting django
105 3 Etienne Pallier
  Downloading Django-1.9.4-py2.py3-none-any.whl (6.6MB)
106 3 Etienne Pallier
Installing collected packages: django
107 3 Etienne Pallier
Successfully installed django-1.9.4
108 3 Etienne Pallier
109 3 Etienne Pallier
$ pip install django-admin-tools
110 3 Etienne Pallier
Collecting django-admin-tools
111 3 Etienne Pallier
  Downloading django_admin_tools-0.7.2-py2.py3-none-any.whl (289kB)
112 3 Etienne Pallier
Installing collected packages: django-admin-tools
113 3 Etienne Pallier
Successfully installed django-admin-tools-0.7.2
114 3 Etienne Pallier
115 3 Etienne Pallier
$ pip install gunicorn
116 3 Etienne Pallier
Collecting gunicorn
117 3 Etienne Pallier
  Downloading gunicorn-19.4.5-py2.py3-none-any.whl (112kB)
118 3 Etienne Pallier
Installing collected packages: gunicorn
119 3 Etienne Pallier
Successfully installed gunicorn-19.4.5
120 3 Etienne Pallier
121 21 Etienne Pallier
$ pip install django-debug-toolbar
122 21 Etienne Pallier
Collecting django-debug-toolbar
123 21 Etienne Pallier
  Downloading django_debug_toolbar-1.4-py2.py3-none-any.whl (212kB)
124 21 Etienne Pallier
Requirement already satisfied (use --upgrade to upgrade): Django>=1.7 in ./venv_py35_pyros/lib/python3.5/site-packages (from django-debug-toolbar)
125 21 Etienne Pallier
Collecting sqlparse (from django-debug-toolbar)
126 21 Etienne Pallier
  Downloading sqlparse-0.1.19.tar.gz (58kB)
127 21 Etienne Pallier
Building wheels for collected packages: sqlparse
128 21 Etienne Pallier
  Running setup.py bdist_wheel for sqlparse ... done
129 21 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/7b/d4/72/6011bb100dd5fc213164e4bbee13d4e03261dd54ce6a5de6b8
130 21 Etienne Pallier
Successfully built sqlparse
131 21 Etienne Pallier
Installing collected packages: sqlparse, django-debug-toolbar
132 21 Etienne Pallier
Successfully installed django-debug-toolbar-1.4 sqlparse-0.1.19
133 21 Etienne Pallier
134 21 Etienne Pallier
$ pip install django-extensions
135 21 Etienne Pallier
Collecting django-extensions
136 21 Etienne Pallier
  Downloading django_extensions-1.6.1-py2.py3-none-any.whl (202kB)
137 21 Etienne Pallier
Collecting six>=1.2 (from django-extensions)
138 21 Etienne Pallier
  Downloading six-1.10.0-py2.py3-none-any.whl
139 21 Etienne Pallier
Installing collected packages: six, django-extensions
140 21 Etienne Pallier
Successfully installed django-extensions-1.6.1 six-1.10.0
141 21 Etienne Pallier
142 21 Etienne Pallier
$ pip install django-suit
143 21 Etienne Pallier
Collecting django-suit
144 21 Etienne Pallier
  Downloading django-suit-0.2.18.tar.gz (587kB)
145 21 Etienne Pallier
Building wheels for collected packages: django-suit
146 21 Etienne Pallier
  Running setup.py bdist_wheel for django-suit ... done
147 21 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/12/8b/9a/e02ab0ad9229881638aa040d47d77c8f562999533811927d41
148 21 Etienne Pallier
Successfully built django-suit
149 21 Etienne Pallier
Installing collected packages: django-suit
150 21 Etienne Pallier
Successfully installed django-suit-0.2.18
151 21 Etienne Pallier
152 21 Etienne Pallier
153 3 Etienne Pallier
$ pip install mysqlclient
154 20 Etienne Pallier
155 20 Etienne Pallier
*Under Mac OS X*:
156 21 Etienne Pallier
<pre>
157 20 Etienne Pallier
158 3 Etienne Pallier
Collecting mysqlclient
159 3 Etienne Pallier
  Downloading mysqlclient-1.3.7.tar.gz (79kB)
160 1 Etienne Pallier
Building wheels for collected packages: mysqlclient
161 22 Etienne Pallier
  Running setup.py bdist_wheel for mysqlclient ... error
162 3 Etienne Pallier
163 3 Etienne Pallier
  ----------------------------------------
164 1 Etienne Pallier
  Failed building wheel for mysqlclient
165 1 Etienne Pallier
  Running setup.py clean for mysqlclient
166 1 Etienne Pallier
Failed to build mysqlclient
167 1 Etienne Pallier
Installing collected packages: mysqlclient
168 1 Etienne Pallier
  Running setup.py install for mysqlclient ... done
169 1 Etienne Pallier
Successfully installed mysqlclient-1.3.7
170 1 Etienne Pallier
171 1 Etienne Pallier
BOUH !!!
172 1 Etienne Pallier
173 1 Etienne Pallier
$ pip install --upgrade wheel
174 1 Etienne Pallier
Collecting wheel
175 1 Etienne Pallier
  Downloading wheel-0.29.0-py2.py3-none-any.whl (66kB)
176 1 Etienne Pallier
Installing collected packages: wheel
177 1 Etienne Pallier
  Found existing installation: wheel 0.24.0
178 1 Etienne Pallier
    Uninstalling wheel-0.24.0:
179 1 Etienne Pallier
      Successfully uninstalled wheel-0.24.0
180 1 Etienne Pallier
Successfully installed wheel-0.29.0
181 1 Etienne Pallier
182 1 Etienne Pallier
$ pip uninstall mysqlclient
183 1 Etienne Pallier
184 1 Etienne Pallier
$ pip install mysqlclient
185 1 Etienne Pallier
Collecting mysqlclient
186 1 Etienne Pallier
  Using cached mysqlclient-1.3.7.tar.gz
187 1 Etienne Pallier
Building wheels for collected packages: mysqlclient
188 1 Etienne Pallier
  Running setup.py bdist_wheel for mysqlclient ... done
189 1 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/9b/06/50/d11418c26cf8f2156b13d4363b5afde8e7e75ebb8540d0228d
190 1 Etienne Pallier
Successfully built mysqlclient
191 1 Etienne Pallier
Installing collected packages: mysqlclient
192 1 Etienne Pallier
Successfully installed mysqlclient-1.3.7
193 1 Etienne Pallier
194 1 Etienne Pallier
YES !!!
195 21 Etienne Pallier
</pre>
196 1 Etienne Pallier
197 1 Etienne Pallier
198 12 Etienne Pallier
199 12 Etienne Pallier
200 12 Etienne Pallier
---
201 12 Etienne Pallier
202 12 Etienne Pallier
h3. Create project dir
203 12 Etienne Pallier
204 12 Etienne Pallier
$ mkdir pyros
205 12 Etienne Pallier
206 12 Etienne Pallier
207 12 Etienne Pallier
 
208 12 Etienne Pallier
Exemple de bonne organisation :
209 12 Etienne Pallier
210 12 Etienne Pallier
1 projet = N applis
211 12 Etienne Pallier
(mais 1 appli peut faire partie de plusieurs projets)
212 12 Etienne Pallier
213 12 Etienne Pallier
MONPROJET/
214 12 Etienne Pallier
	src/
215 12 Etienne Pallier
		monprojet/
216 12 Etienne Pallier
		appli1
217 12 Etienne Pallier
		appli2
218 12 Etienne Pallier
219 12 Etienne Pallier
		appliN
220 12 Etienne Pallier
	public/
221 12 Etienne Pallier
	private/
222 12 Etienne Pallier
		requirements.txt
223 12 Etienne Pallier
224 12 Etienne Pallier
225 12 Etienne Pallier
226 12 Etienne Pallier
---
227 12 Etienne Pallier
228 12 Etienne Pallier
h3. Set needed folders (inside pyros/)
229 12 Etienne Pallier
230 12 Etienne Pallier
$ mkdir private public
231 12 Etienne Pallier
$ mkdir public/static
232 1 Etienne Pallier
233 3 Etienne Pallier
234 7 Etienne Pallier
---
235 3 Etienne Pallier
236 7 Etienne Pallier
h3. Create django project pyros
237 7 Etienne Pallier
238 3 Etienne Pallier
$ django-admin startproject pyros
239 3 Etienne Pallier
240 3 Etienne Pallier
$ tree pyros/
241 3 Etienne Pallier
pyros/
242 3 Etienne Pallier
├── manage.py
243 3 Etienne Pallier
└── pyros
244 3 Etienne Pallier
    ├── __init__.py
245 3 Etienne Pallier
    ├── settings.py
246 3 Etienne Pallier
    ├── urls.py
247 3 Etienne Pallier
    └── wsgi.py
248 3 Etienne Pallier
249 3 Etienne Pallier
250 3 Etienne Pallier
$ mv pyros src
251 3 Etienne Pallier
252 3 Etienne Pallier
$ cd src/
253 3 Etienne Pallier
254 1 Etienne Pallier
$ ./manage.py runserver
255 3 Etienne Pallier
(ou gunicorn pyros.wsgi)
256 1 Etienne Pallier
==> http://localhost:8000
257 1 Etienne Pallier
258 3 Etienne Pallier
259 3 Etienne Pallier
260 7 Etienne Pallier
---
261 3 Etienne Pallier
262 7 Etienne Pallier
h3. Set Database mysql
263 7 Etienne Pallier
264 3 Etienne Pallier
Edit src/pyros/settings.py
265 3 Etienne Pallier
266 3 Etienne Pallier
DATABASES = {
267 3 Etienne Pallier
    'default': {
268 3 Etienne Pallier
        'ENGINE': 'django.db.backends.mysql',
269 1 Etienne Pallier
        'NAME': 'pyros',
270 3 Etienne Pallier
        'USER': 'root',
271 1 Etienne Pallier
        'PASSWORD': ''
272 1 Etienne Pallier
    }
273 3 Etienne Pallier
}
274 3 Etienne Pallier
275 3 Etienne Pallier
276 7 Etienne Pallier
---
277 3 Etienne Pallier
278 7 Etienne Pallier
h3. Import database into django
279 7 Etienne Pallier
280 3 Etienne Pallier
cd src/
281 3 Etienne Pallier
282 3 Etienne Pallier
$ ./manage.py inspectdb > models.py
283 3 Etienne Pallier
284 3 Etienne Pallier
Traceback (most recent call last):
285 3 Etienne Pallier
  File "/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/django/db/backends/mysql/base.py", line 25, in <module>
286 3 Etienne Pallier
    import MySQLdb as Database
287 3 Etienne Pallier
  File "/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/MySQLdb/__init__.py", line 19, in <module>
288 3 Etienne Pallier
    import _mysql
289 3 Etienne Pallier
ImportError: dlopen(/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so, 2): Library not loaded: libmysqlclient.18.dylib
290 3 Etienne Pallier
  Referenced from: /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
291 3 Etienne Pallier
  Reason: image not found
292 3 Etienne Pallier
293 3 Etienne Pallier
=> BOUH !!!
294 3 Etienne Pallier
295 3 Etienne Pallier
LA SOLUTION EST ICI : http://stackoverflow.com/questions/6383310/python-mysqldb-library-not-loaded-libmysqlclient-18-dylib
296 3 Etienne Pallier
297 3 Etienne Pallier
(
298 3 Etienne Pallier
Apparemment, ceci aurait dû suffire:
299 3 Etienne Pallier
mkdir -p /usr/local/lib   
300 3 Etienne Pallier
ln -s /usr/local/mysql/lib/libmysql* /usr/local/lib
301 3 Etienne Pallier
)
302 3 Etienne Pallier
303 3 Etienne Pallier
304 3 Etienne Pallier
Mais j’ai fait ceci:
305 3 Etienne Pallier
306 3 Etienne Pallier
$ otool -L /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
307 3 Etienne Pallier
/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so:
308 1 Etienne Pallier
	libmysqlclient.18.dylib (compatibility version 18.0.0, current version 18.0.0)
309 10 Etienne Pallier
...
310 3 Etienne Pallier
311 3 Etienne Pallier
$ locate libmysqlclient.18.dylib
312 3 Etienne Pallier
/Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib
313 1 Etienne Pallier
/Library/SystemMigration/History/Migration-68137DFB-CB6A-4FBB-81E2-11BDB5D01E48/QuarantineRoot/usr/lib/libmysqlclient.18.dylib
314 1 Etienne Pallier
315 1 Etienne Pallier
$ sudo install_name_tool -change libmysqlclient.18.dylib /Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
316 1 Etienne Pallier
317 10 Etienne Pallier
$ otool -L /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
318 10 Etienne Pallier
/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so:
319 10 Etienne Pallier
	/Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib (compatibility version 18.0.0, current version 18.0.0)
320 10 Etienne Pallier
...
321 3 Etienne Pallier
322 1 Etienne Pallier
$ ./manage.py inspectdb > models.py
323 1 Etienne Pallier
324 3 Etienne Pallier
=> YES !!!
325 3 Etienne Pallier
326 3 Etienne Pallier
327 3 Etienne Pallier
328 7 Etienne Pallier
---
329 3 Etienne Pallier
330 7 Etienne Pallier
h3. Create a django application pyrosapp
331 7 Etienne Pallier
332 3 Etienne Pallier
$ ./manage.py startapp pyrosapp
333 3 Etienne Pallier
334 3 Etienne Pallier
$ tree src
335 3 Etienne Pallier
src
336 3 Etienne Pallier
├── db.sqlite3
337 3 Etienne Pallier
├── manage.py
338 3 Etienne Pallier
├── pyros
339 3 Etienne Pallier
│   ├── __init__.py
340 3 Etienne Pallier
│   ├── __pycache__
341 3 Etienne Pallier
│   │   ├── __init__.cpython-35.pyc
342 3 Etienne Pallier
│   │   ├── settings.cpython-35.pyc
343 3 Etienne Pallier
│   │   ├── urls.cpython-35.pyc
344 3 Etienne Pallier
│   │   └── wsgi.cpython-35.pyc
345 3 Etienne Pallier
│   ├── settings.py
346 3 Etienne Pallier
│   ├── urls.py
347 3 Etienne Pallier
│   └── wsgi.py
348 3 Etienne Pallier
└── pyrosapp
349 3 Etienne Pallier
    ├── __init__.py
350 1 Etienne Pallier
    ├── admin.py
351 3 Etienne Pallier
    ├── apps.py
352 1 Etienne Pallier
    ├── migrations
353 1 Etienne Pallier
    │   └── __init__.py
354 3 Etienne Pallier
    ├── models.py
355 3 Etienne Pallier
    ├── tests.py
356 3 Etienne Pallier
    └── views.py
357 1 Etienne Pallier
358 1 Etienne Pallier
359 7 Etienne Pallier
---
360 1 Etienne Pallier
361 7 Etienne Pallier
h3. Replace the default pyrosapp models.py with the inspectdb generated one
362 7 Etienne Pallier
363 3 Etienne Pallier
$ mv models.py pyrosapp/
364 3 Etienne Pallier
365 3 Etienne Pallier
366 3 Etienne Pallier
367 3 Etienne Pallier
368 7 Etienne Pallier
369 1 Etienne Pallier
---
370 9 Etienne Pallier
371 7 Etienne Pallier
*TODO*
372 7 Etienne Pallier
373 7 Etienne Pallier
h3. Fix and improve the inspectdb generated file models.py
374 3 Etienne Pallier
375 3 Etienne Pallier
$ cd pyrosapp/
376 3 Etienne Pallier
377 8 Etienne Pallier
$ vi models.py