Wiki

Version 23 (Etienne Pallier, 03/18/2016 10:31 am)

1 1 Etienne Pallier
h1. Technical Documentation for the PYROS project (FGFT-CC)
2 1 Etienne Pallier
3 1 Etienne Pallier
4 1 Etienne Pallier
HOWTO Format Redmine Wiki : http://www.redmine.org/projects/redmine/wiki/FrRedmineWikiFormatting
5 1 Etienne Pallier
6 1 Etienne Pallier
{{>toc}}
7 1 Etienne Pallier
8 1 Etienne Pallier
9 1 Etienne Pallier
10 3 Etienne Pallier
---
11 1 Etienne Pallier
12 17 Etienne Pallier
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}I - INSTALLATION%
13 2 Etienne Pallier
14 2 Etienne Pallier
15 1 Etienne Pallier
16 6 Etienne Pallier
h3. Create database
17 1 Etienne Pallier
18 3 Etienne Pallier
One liner:
19 3 Etienne Pallier
$ mysql -u root < pyros.sql
20 1 Etienne Pallier
21 3 Etienne Pallier
Or :
22 3 Etienne Pallier
$ mysql -u root
23 3 Etienne Pallier
mysql> create database pyros;
24 3 Etienne Pallier
mysql> use pyros;
25 3 Etienne Pallier
mysql> source pyros.sql;
26 1 Etienne Pallier
27 3 Etienne Pallier
(
28 3 Etienne Pallier
TODO:
29 3 Etienne Pallier
mysql> grant all on pyros.* to pyros@localhost identified by ‘pyros’;)
30 3 Etienne Pallier
mysql> flush privileges;
31 3 Etienne Pallier
)
32 1 Etienne Pallier
33 1 Etienne Pallier
34 1 Etienne Pallier
35 4 Etienne Pallier
---
36 5 Etienne Pallier
37 6 Etienne Pallier
h3. Install python3.5
38 1 Etienne Pallier
39 11 Etienne Pallier
40 11 Etienne Pallier
 * Mac OS X :
41 23 Etienne Pallier
<pre>
42 1 Etienne Pallier
$ sudo port install python35
43 23 Etienne Pallier
</pre>
44 1 Etienne Pallier
45 11 Etienne Pallier
 * Linux (Ubuntu) :
46 23 Etienne Pallier
<pre>
47 1 Etienne Pallier
$ sudo apt-get ...
48 23 Etienne Pallier
</pre>
49 1 Etienne Pallier
50 5 Etienne Pallier
51 3 Etienne Pallier
52 4 Etienne Pallier
---
53 5 Etienne Pallier
54 13 Etienne Pallier
h3. Create project dir
55 13 Etienne Pallier
56 13 Etienne Pallier
$ mkdir pyros
57 13 Etienne Pallier
58 13 Etienne Pallier
59 13 Etienne Pallier
---
60 13 Etienne Pallier
61 14 Etienne Pallier
h3. Create virtualenv with python3.5 dedicated to pyros project
62 3 Etienne Pallier
63 3 Etienne Pallier
$ cd pyros/
64 3 Etienne Pallier
65 3 Etienne Pallier
$ which python3.5
66 3 Etienne Pallier
/opt/local/bin/python3.5
67 3 Etienne Pallier
68 15 Etienne Pallier
$ virtualenv-3.5 venv_py35_pyros -p /opt/local/bin/python3.5
69 3 Etienne Pallier
=> creates a venv_py35_pyros/ folder inside pyros/
70 3 Etienne Pallier
71 1 Etienne Pallier
72 1 Etienne Pallier
73 7 Etienne Pallier
---
74 3 Etienne Pallier
75 16 Etienne Pallier
h3. Activate venv
76 7 Etienne Pallier
77 3 Etienne Pallier
$ source venv_py35_pyros/bin/activate
78 3 Etienne Pallier
79 3 Etienne Pallier
$ python -V
80 3 Etienne Pallier
Python 3.5.1
81 3 Etienne Pallier
82 3 Etienne Pallier
$ which pip
83 1 Etienne Pallier
…/pyros/venv_py35_pyros/bin/pip
84 16 Etienne Pallier
85 18 Etienne Pallier
Upgrade pip to last version available :
86 3 Etienne Pallier
87 3 Etienne Pallier
$ pip install --upgrade pip
88 3 Etienne Pallier
Collecting pip
89 3 Etienne Pallier
  Downloading pip-8.1.1-py2.py3-none-any.whl (1.2MB)
90 3 Etienne Pallier
Installing collected packages: pip
91 3 Etienne Pallier
  Found existing installation: pip 7.1.2
92 3 Etienne Pallier
    Uninstalling pip-7.1.2:
93 3 Etienne Pallier
      Successfully uninstalled pip-7.1.2
94 1 Etienne Pallier
Successfully installed pip-8.1.1
95 18 Etienne Pallier
96 18 Etienne Pallier
h3. From within the virtual environment, install needed python packages
97 18 Etienne Pallier
98 3 Etienne Pallier
99 3 Etienne Pallier
$ pip install django
100 3 Etienne Pallier
Collecting django
101 3 Etienne Pallier
  Downloading Django-1.9.4-py2.py3-none-any.whl (6.6MB)
102 3 Etienne Pallier
Installing collected packages: django
103 3 Etienne Pallier
Successfully installed django-1.9.4
104 3 Etienne Pallier
105 3 Etienne Pallier
$ pip install django-admin-tools
106 3 Etienne Pallier
Collecting django-admin-tools
107 3 Etienne Pallier
  Downloading django_admin_tools-0.7.2-py2.py3-none-any.whl (289kB)
108 3 Etienne Pallier
Installing collected packages: django-admin-tools
109 3 Etienne Pallier
Successfully installed django-admin-tools-0.7.2
110 3 Etienne Pallier
111 3 Etienne Pallier
$ pip install gunicorn
112 3 Etienne Pallier
Collecting gunicorn
113 3 Etienne Pallier
  Downloading gunicorn-19.4.5-py2.py3-none-any.whl (112kB)
114 3 Etienne Pallier
Installing collected packages: gunicorn
115 3 Etienne Pallier
Successfully installed gunicorn-19.4.5
116 3 Etienne Pallier
117 21 Etienne Pallier
$ pip install django-debug-toolbar
118 21 Etienne Pallier
Collecting django-debug-toolbar
119 21 Etienne Pallier
  Downloading django_debug_toolbar-1.4-py2.py3-none-any.whl (212kB)
120 21 Etienne Pallier
Requirement already satisfied (use --upgrade to upgrade): Django>=1.7 in ./venv_py35_pyros/lib/python3.5/site-packages (from django-debug-toolbar)
121 21 Etienne Pallier
Collecting sqlparse (from django-debug-toolbar)
122 21 Etienne Pallier
  Downloading sqlparse-0.1.19.tar.gz (58kB)
123 21 Etienne Pallier
Building wheels for collected packages: sqlparse
124 21 Etienne Pallier
  Running setup.py bdist_wheel for sqlparse ... done
125 21 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/7b/d4/72/6011bb100dd5fc213164e4bbee13d4e03261dd54ce6a5de6b8
126 21 Etienne Pallier
Successfully built sqlparse
127 21 Etienne Pallier
Installing collected packages: sqlparse, django-debug-toolbar
128 21 Etienne Pallier
Successfully installed django-debug-toolbar-1.4 sqlparse-0.1.19
129 21 Etienne Pallier
130 21 Etienne Pallier
$ pip install django-extensions
131 21 Etienne Pallier
Collecting django-extensions
132 21 Etienne Pallier
  Downloading django_extensions-1.6.1-py2.py3-none-any.whl (202kB)
133 21 Etienne Pallier
Collecting six>=1.2 (from django-extensions)
134 21 Etienne Pallier
  Downloading six-1.10.0-py2.py3-none-any.whl
135 21 Etienne Pallier
Installing collected packages: six, django-extensions
136 21 Etienne Pallier
Successfully installed django-extensions-1.6.1 six-1.10.0
137 21 Etienne Pallier
138 21 Etienne Pallier
$ pip install django-suit
139 21 Etienne Pallier
Collecting django-suit
140 21 Etienne Pallier
  Downloading django-suit-0.2.18.tar.gz (587kB)
141 21 Etienne Pallier
Building wheels for collected packages: django-suit
142 21 Etienne Pallier
  Running setup.py bdist_wheel for django-suit ... done
143 21 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/12/8b/9a/e02ab0ad9229881638aa040d47d77c8f562999533811927d41
144 21 Etienne Pallier
Successfully built django-suit
145 21 Etienne Pallier
Installing collected packages: django-suit
146 21 Etienne Pallier
Successfully installed django-suit-0.2.18
147 21 Etienne Pallier
148 21 Etienne Pallier
149 3 Etienne Pallier
$ pip install mysqlclient
150 20 Etienne Pallier
151 20 Etienne Pallier
*Under Mac OS X*:
152 21 Etienne Pallier
<pre>
153 20 Etienne Pallier
154 3 Etienne Pallier
Collecting mysqlclient
155 3 Etienne Pallier
  Downloading mysqlclient-1.3.7.tar.gz (79kB)
156 1 Etienne Pallier
Building wheels for collected packages: mysqlclient
157 22 Etienne Pallier
  Running setup.py bdist_wheel for mysqlclient ... error
158 3 Etienne Pallier
159 3 Etienne Pallier
  ----------------------------------------
160 1 Etienne Pallier
  Failed building wheel for mysqlclient
161 1 Etienne Pallier
  Running setup.py clean for mysqlclient
162 1 Etienne Pallier
Failed to build mysqlclient
163 1 Etienne Pallier
Installing collected packages: mysqlclient
164 1 Etienne Pallier
  Running setup.py install for mysqlclient ... done
165 1 Etienne Pallier
Successfully installed mysqlclient-1.3.7
166 1 Etienne Pallier
167 1 Etienne Pallier
BOUH !!!
168 1 Etienne Pallier
169 1 Etienne Pallier
$ pip install --upgrade wheel
170 1 Etienne Pallier
Collecting wheel
171 1 Etienne Pallier
  Downloading wheel-0.29.0-py2.py3-none-any.whl (66kB)
172 1 Etienne Pallier
Installing collected packages: wheel
173 1 Etienne Pallier
  Found existing installation: wheel 0.24.0
174 1 Etienne Pallier
    Uninstalling wheel-0.24.0:
175 1 Etienne Pallier
      Successfully uninstalled wheel-0.24.0
176 1 Etienne Pallier
Successfully installed wheel-0.29.0
177 1 Etienne Pallier
178 1 Etienne Pallier
$ pip uninstall mysqlclient
179 1 Etienne Pallier
180 1 Etienne Pallier
$ pip install mysqlclient
181 1 Etienne Pallier
Collecting mysqlclient
182 1 Etienne Pallier
  Using cached mysqlclient-1.3.7.tar.gz
183 1 Etienne Pallier
Building wheels for collected packages: mysqlclient
184 1 Etienne Pallier
  Running setup.py bdist_wheel for mysqlclient ... done
185 1 Etienne Pallier
  Stored in directory: /Users/epallier/Library/Caches/pip/wheels/9b/06/50/d11418c26cf8f2156b13d4363b5afde8e7e75ebb8540d0228d
186 1 Etienne Pallier
Successfully built mysqlclient
187 1 Etienne Pallier
Installing collected packages: mysqlclient
188 1 Etienne Pallier
Successfully installed mysqlclient-1.3.7
189 1 Etienne Pallier
190 1 Etienne Pallier
YES !!!
191 21 Etienne Pallier
</pre>
192 1 Etienne Pallier
193 1 Etienne Pallier
194 12 Etienne Pallier
195 12 Etienne Pallier
196 12 Etienne Pallier
---
197 12 Etienne Pallier
198 12 Etienne Pallier
h3. Create project dir
199 12 Etienne Pallier
200 12 Etienne Pallier
$ mkdir pyros
201 12 Etienne Pallier
202 12 Etienne Pallier
203 12 Etienne Pallier
 
204 12 Etienne Pallier
Exemple de bonne organisation :
205 12 Etienne Pallier
206 12 Etienne Pallier
1 projet = N applis
207 12 Etienne Pallier
(mais 1 appli peut faire partie de plusieurs projets)
208 12 Etienne Pallier
209 12 Etienne Pallier
MONPROJET/
210 12 Etienne Pallier
	src/
211 12 Etienne Pallier
		monprojet/
212 12 Etienne Pallier
		appli1
213 12 Etienne Pallier
		appli2
214 12 Etienne Pallier
215 12 Etienne Pallier
		appliN
216 12 Etienne Pallier
	public/
217 12 Etienne Pallier
	private/
218 12 Etienne Pallier
		requirements.txt
219 12 Etienne Pallier
220 12 Etienne Pallier
221 12 Etienne Pallier
222 12 Etienne Pallier
---
223 12 Etienne Pallier
224 12 Etienne Pallier
h3. Set needed folders (inside pyros/)
225 12 Etienne Pallier
226 12 Etienne Pallier
$ mkdir private public
227 12 Etienne Pallier
$ mkdir public/static
228 1 Etienne Pallier
229 3 Etienne Pallier
230 7 Etienne Pallier
---
231 3 Etienne Pallier
232 7 Etienne Pallier
h3. Create django project pyros
233 7 Etienne Pallier
234 3 Etienne Pallier
$ django-admin startproject pyros
235 3 Etienne Pallier
236 3 Etienne Pallier
$ tree pyros/
237 3 Etienne Pallier
pyros/
238 3 Etienne Pallier
├── manage.py
239 3 Etienne Pallier
└── pyros
240 3 Etienne Pallier
    ├── __init__.py
241 3 Etienne Pallier
    ├── settings.py
242 3 Etienne Pallier
    ├── urls.py
243 3 Etienne Pallier
    └── wsgi.py
244 3 Etienne Pallier
245 3 Etienne Pallier
246 3 Etienne Pallier
$ mv pyros src
247 3 Etienne Pallier
248 3 Etienne Pallier
$ cd src/
249 3 Etienne Pallier
250 1 Etienne Pallier
$ ./manage.py runserver
251 3 Etienne Pallier
(ou gunicorn pyros.wsgi)
252 1 Etienne Pallier
==> http://localhost:8000
253 1 Etienne Pallier
254 3 Etienne Pallier
255 3 Etienne Pallier
256 7 Etienne Pallier
---
257 3 Etienne Pallier
258 7 Etienne Pallier
h3. Set Database mysql
259 7 Etienne Pallier
260 3 Etienne Pallier
Edit src/pyros/settings.py
261 3 Etienne Pallier
262 3 Etienne Pallier
DATABASES = {
263 3 Etienne Pallier
    'default': {
264 3 Etienne Pallier
        'ENGINE': 'django.db.backends.mysql',
265 1 Etienne Pallier
        'NAME': 'pyros',
266 3 Etienne Pallier
        'USER': 'root',
267 1 Etienne Pallier
        'PASSWORD': ''
268 1 Etienne Pallier
    }
269 3 Etienne Pallier
}
270 3 Etienne Pallier
271 3 Etienne Pallier
272 7 Etienne Pallier
---
273 3 Etienne Pallier
274 7 Etienne Pallier
h3. Import database into django
275 7 Etienne Pallier
276 3 Etienne Pallier
cd src/
277 3 Etienne Pallier
278 3 Etienne Pallier
$ ./manage.py inspectdb > models.py
279 3 Etienne Pallier
280 3 Etienne Pallier
Traceback (most recent call last):
281 3 Etienne Pallier
  File "/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/django/db/backends/mysql/base.py", line 25, in <module>
282 3 Etienne Pallier
    import MySQLdb as Database
283 3 Etienne Pallier
  File "/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/MySQLdb/__init__.py", line 19, in <module>
284 3 Etienne Pallier
    import _mysql
285 3 Etienne Pallier
ImportError: dlopen(/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so, 2): Library not loaded: libmysqlclient.18.dylib
286 3 Etienne Pallier
  Referenced from: /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
287 3 Etienne Pallier
  Reason: image not found
288 3 Etienne Pallier
289 3 Etienne Pallier
=> BOUH !!!
290 3 Etienne Pallier
291 3 Etienne Pallier
LA SOLUTION EST ICI : http://stackoverflow.com/questions/6383310/python-mysqldb-library-not-loaded-libmysqlclient-18-dylib
292 3 Etienne Pallier
293 3 Etienne Pallier
(
294 3 Etienne Pallier
Apparemment, ceci aurait dû suffire:
295 3 Etienne Pallier
mkdir -p /usr/local/lib   
296 3 Etienne Pallier
ln -s /usr/local/mysql/lib/libmysql* /usr/local/lib
297 3 Etienne Pallier
)
298 3 Etienne Pallier
299 3 Etienne Pallier
300 3 Etienne Pallier
Mais j’ai fait ceci:
301 3 Etienne Pallier
302 3 Etienne Pallier
$ otool -L /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
303 3 Etienne Pallier
/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so:
304 1 Etienne Pallier
	libmysqlclient.18.dylib (compatibility version 18.0.0, current version 18.0.0)
305 10 Etienne Pallier
...
306 3 Etienne Pallier
307 3 Etienne Pallier
$ locate libmysqlclient.18.dylib
308 3 Etienne Pallier
/Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib
309 1 Etienne Pallier
/Library/SystemMigration/History/Migration-68137DFB-CB6A-4FBB-81E2-11BDB5D01E48/QuarantineRoot/usr/lib/libmysqlclient.18.dylib
310 1 Etienne Pallier
311 1 Etienne Pallier
$ sudo install_name_tool -change libmysqlclient.18.dylib /Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
312 1 Etienne Pallier
313 10 Etienne Pallier
$ otool -L /Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so
314 10 Etienne Pallier
/Users/epallier/Documents/_W_more/PROJECTS/GFT/SOFT/PYROS/pyros/venv_py35_pyros/lib/python3.5/site-packages/_mysql.cpython-35m-darwin.so:
315 10 Etienne Pallier
	/Applications/XAMPP/xamppfiles/lib/libmysqlclient.18.dylib (compatibility version 18.0.0, current version 18.0.0)
316 10 Etienne Pallier
...
317 3 Etienne Pallier
318 1 Etienne Pallier
$ ./manage.py inspectdb > models.py
319 1 Etienne Pallier
320 3 Etienne Pallier
=> YES !!!
321 3 Etienne Pallier
322 3 Etienne Pallier
323 3 Etienne Pallier
324 7 Etienne Pallier
---
325 3 Etienne Pallier
326 7 Etienne Pallier
h3. Create a django application pyrosapp
327 7 Etienne Pallier
328 3 Etienne Pallier
$ ./manage.py startapp pyrosapp
329 3 Etienne Pallier
330 3 Etienne Pallier
$ tree src
331 3 Etienne Pallier
src
332 3 Etienne Pallier
├── db.sqlite3
333 3 Etienne Pallier
├── manage.py
334 3 Etienne Pallier
├── pyros
335 3 Etienne Pallier
│   ├── __init__.py
336 3 Etienne Pallier
│   ├── __pycache__
337 3 Etienne Pallier
│   │   ├── __init__.cpython-35.pyc
338 3 Etienne Pallier
│   │   ├── settings.cpython-35.pyc
339 3 Etienne Pallier
│   │   ├── urls.cpython-35.pyc
340 3 Etienne Pallier
│   │   └── wsgi.cpython-35.pyc
341 3 Etienne Pallier
│   ├── settings.py
342 3 Etienne Pallier
│   ├── urls.py
343 3 Etienne Pallier
│   └── wsgi.py
344 3 Etienne Pallier
└── pyrosapp
345 3 Etienne Pallier
    ├── __init__.py
346 1 Etienne Pallier
    ├── admin.py
347 3 Etienne Pallier
    ├── apps.py
348 1 Etienne Pallier
    ├── migrations
349 1 Etienne Pallier
    │   └── __init__.py
350 3 Etienne Pallier
    ├── models.py
351 3 Etienne Pallier
    ├── tests.py
352 3 Etienne Pallier
    └── views.py
353 1 Etienne Pallier
354 1 Etienne Pallier
355 7 Etienne Pallier
---
356 1 Etienne Pallier
357 7 Etienne Pallier
h3. Replace the default pyrosapp models.py with the inspectdb generated one
358 7 Etienne Pallier
359 3 Etienne Pallier
$ mv models.py pyrosapp/
360 3 Etienne Pallier
361 3 Etienne Pallier
362 3 Etienne Pallier
363 3 Etienne Pallier
364 7 Etienne Pallier
365 1 Etienne Pallier
---
366 9 Etienne Pallier
367 7 Etienne Pallier
*TODO*
368 7 Etienne Pallier
369 7 Etienne Pallier
h3. Fix and improve the inspectdb generated file models.py
370 3 Etienne Pallier
371 3 Etienne Pallier
$ cd pyrosapp/
372 3 Etienne Pallier
373 8 Etienne Pallier
$ vi models.py