Pyros applications

Version 27 (Paul Carensac, 05/19/2016 03:49 pm)

1 1 Paul Carensac
h1. Pyros applications
2 1 Paul Carensac
3 2 Paul Carensac
List and details of all the pyros applications.
4 2 Paul Carensac
5 17 Paul Carensac
{{>toc}}
6 17 Paul Carensac
7 2 Paul Carensac
---
8 2 Paul Carensac
9 2 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}pyrosapp%
10 2 Paul Carensac
11 3 Paul Carensac
h3. Purpose
12 2 Paul Carensac
13 2 Paul Carensac
 * Contains all the database Models
14 2 Paul Carensac
 * Basic tests in tests.py
15 2 Paul Carensac
 * Backoffice configuration in admin.py
16 2 Paul Carensac
17 3 Paul Carensac
h3. Notes
18 2 Paul Carensac
19 2 Paul Carensac
 * Will be progressively deleted while models being displaced
20 2 Paul Carensac
21 2 Paul Carensac
---
22 2 Paul Carensac
23 2 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}dashboard%
24 2 Paul Carensac
25 3 Paul Carensac
h3. Purpose
26 2 Paul Carensac
27 2 Paul Carensac
 * Interface for all external users
28 2 Paul Carensac
 * Leads to displays and actions for all the pyros modules (users, requests, system execution, ...)
29 2 Paul Carensac
30 4 Paul Carensac
h3. Evolution
31 4 Paul Carensac
32 4 Paul Carensac
 * Creating application
33 4 Paul Carensac
34 4 Paul Carensac
    * manage.py startapp dashboard
35 5 Paul Carensac
    * added 'dashboard' in settings.py -> INSTALLED_APPS
36 5 Paul Carensac
    * created a urls.py file in dashboard module
37 5 Paul Carensac
    * added _url(r'^dashboard/', include('dashboard.urls'))_ in pyros/urls.py -> urlpatterns
38 5 Paul Carensac
    * created templates/ and templates/dashboard/ folders in dashboard module
39 5 Paul Carensac
40 5 Paul Carensac
 * Main page
41 5 Paul Carensac
42 5 Paul Carensac
    * added 'home' view in views.py
43 5 Paul Carensac
    * linked 'home' view to 8000/dashboard URL
44 5 Paul Carensac
    * created a template for the homepage in templates/dashboard/ (with bootstrap)
45 5 Paul Carensac
    * created views, views linking (urls.py) and templates for the dashboard modules
46 5 Paul Carensac
    * redirected mainpage buttons to Admin interface (temporary)
47 4 Paul Carensac
48 22 Paul Carensac
 * System page (logs)
49 22 Paul Carensac
50 22 Paul Carensac
    * Retrieve logs from the db
51 26 Paul Carensac
    * Print logs and automatically update every second via an ajax request
52 22 Paul Carensac
53 3 Paul Carensac
h3. Notes
54 2 Paul Carensac
55 2 Paul Carensac
 * The buttons lead to the Admin interface for the moment
56 7 Paul Carensac
 * Added bootstrap3 module (see Installation)
57 7 Paul Carensac
 * Added Django Template Editor (see Eclipse configuration)
58 2 Paul Carensac
59 3 Paul Carensac
h3. TODO
60 2 Paul Carensac
61 2 Paul Carensac
 * Create the backoffice views as the modules are integrated in pyros
62 2 Paul Carensac
 * Think about a system of permissions
63 2 Paul Carensac
64 2 Paul Carensac
---
65 8 Paul Carensac
66 8 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}scheduler%
67 8 Paul Carensac
68 8 Paul Carensac
h3. Purpose
69 8 Paul Carensac
70 8 Paul Carensac
 * Creates the planning with the OBSERVABLE sequences
71 8 Paul Carensac
 * Give acces to a web page to see the current planning
72 8 Paul Carensac
73 8 Paul Carensac
h3. Evolution
74 8 Paul Carensac
75 8 Paul Carensac
 * Creating application
76 8 Paul Carensac
77 8 Paul Carensac
    * manage.py startapp scheduler
78 8 Paul Carensac
    * added 'scheduler' in settings.py -> INSTALLED_APPS
79 8 Paul Carensac
    * created a urls.py file in scheduler module
80 8 Paul Carensac
    * added _url(r'^scheduler/', include('scheduler.urls'))_ in pyros/urls.py -> urlpatterns
81 8 Paul Carensac
    * created templates/ and templates/scheduler/ folders in scheduler module
82 8 Paul Carensac
83 9 Paul Carensac
 * Model modifications
84 1 Paul Carensac
85 9 Paul Carensac
    * Schedule
86 9 Paul Carensac
87 9 Paul Carensac
        * Remove day_start
88 9 Paul Carensac
        * Remove day_stop
89 9 Paul Carensac
        * Add plan_start
90 13 Paul Carensac
        * Add plan_end
91 9 Paul Carensac
        * Enum system for the status 
92 9 Paul Carensac
    * ScheduleHistory
93 9 Paul Carensac
94 9 Paul Carensac
        * Remove day_start
95 9 Paul Carensac
        * Remove day_stop
96 9 Paul Carensac
        * Add plan_start
97 13 Paul Carensac
        * Add plan_end
98 9 Paul Carensac
    * Sequence
99 9 Paul Carensac
100 9 Paul Carensac
        * Remove exec_start
101 9 Paul Carensac
        * Remove exec_stop
102 9 Paul Carensac
        * Add tsp
103 9 Paul Carensac
        * Add tep
104 9 Paul Carensac
        * Add jd1
105 9 Paul Carensac
        * Add jd2
106 9 Paul Carensac
        * Add deltaTL
107 9 Paul Carensac
        * Add deltaTR
108 9 Paul Carensac
        * Add t_prefered
109 9 Paul Carensac
        * Changed duration from Float to DecimalField (more precise)
110 15 Paul Carensac
        * Add overhead
111 15 Paul Carensac
112 10 Paul Carensac
    * manage.py makemigrations sheduler ; manage.py migrate
113 10 Paul Carensac
114 10 Paul Carensac
 * Creation of Scheduler and Interval classes in models.py
115 10 Paul Carensac
116 10 Paul Carensac
 * Implementation of the Interval class
117 10 Paul Carensac
118 12 Paul Carensac
 * Implementation of the Scheduler's 'make_schedule' function (and children). This is the only entry point for now. This function creates the planning (organizes the observable sequences).
119 9 Paul Carensac
120 14 Paul Carensac
 * Creation of the web interface
121 14 Paul Carensac
122 14 Paul Carensac
    * Added current_schedule.html in template/scheduler folder
123 14 Paul Carensac
    * Created view and url linking to this template (with current planning retrieving)
124 14 Paul Carensac
125 14 Paul Carensac
 * Creation of the simulator
126 14 Paul Carensac
127 14 Paul Carensac
    * Created a second entry point in the Scheduler class (with a few minor adaptations to handle SIMULATION mode)
128 14 Paul Carensac
    * Created a simulator module in the scheduler
129 14 Paul Carensac
        
130 14 Paul Carensac
        * Added the MyHTMLParser class (easy implementation of HTMLParser)
131 23 Paul Carensac
        * Added Simulator class. It parses a file given in parametr to retrieve sequences and create a schedule
132 14 Paul Carensac
    * Created a second view linked to schedule/simulation to show simulation results
133 1 Paul Carensac
 
134 23 Paul Carensac
 * Main update 19/05/2016 : overheads & historic system
135 23 Paul Carensac
136 23 Paul Carensac
    * Deleted ScheduleHistory
137 23 Paul Carensac
    * Transformed the Sequence - Schedule relation to ManyToMany
138 23 Paul Carensac
    * Moved the scheduling information into the M2M relationship class (shs = ScheduleHasSequences)
139 23 Paul Carensac
    * Added a static overhead into scheduling (can be set from the calling code, through scheduler.max_overhead = blabla(float))
140 23 Paul Carensac
141 23 Paul Carensac
h3. Tests
142 23 Paul Carensac
143 24 Paul Carensac
 * Some tests in test.py to test the different functionalities of the scheduler
144 24 Paul Carensac
 * A simulator at localhost:8000/scheduler/simulation, taking sequences from scheduler/sequences_cador.html
145 24 Paul Carensac
146 8 Paul Carensac
h3. Notes
147 1 Paul Carensac
148 1 Paul Carensac
 * Priorities and quotas are default-calculated (for the moment)
149 9 Paul Carensac
 * What is the 'flag' attribute in the Schedule model ?
150 1 Paul Carensac
151 9 Paul Carensac
h3. TODO
152 13 Paul Carensac
153 9 Paul Carensac
 * Determine plan_start & plan_end
154 9 Paul Carensac
 * Priority and quota computing
155 1 Paul Carensac
 * Re-scheduling
156 9 Paul Carensac
 * Blank space filling
157 23 Paul Carensac
 * Change t_prefered handling (place in nearest interval instead of first-before)
158 18 Paul Carensac
159 18 Paul Carensac
---
160 18 Paul Carensac
161 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}alert_manager%
162 18 Paul Carensac
163 18 Paul Carensac
h3. Purpose
164 18 Paul Carensac
165 18 Paul Carensac
 * Listen to VOEvent network
166 18 Paul Carensac
 * Sort interesting events
167 18 Paul Carensac
 * Create requests according to these events
168 18 Paul Carensac
 * Manage the requests created via the alerts
169 18 Paul Carensac
170 18 Paul Carensac
h3. Evolution
171 18 Paul Carensac
172 18 Paul Carensac
 * Creating application
173 18 Paul Carensac
174 18 Paul Carensac
    * See scheduler documentation above
175 18 Paul Carensac
176 18 Paul Carensac
 * Implementation of the agent system
177 18 Paul Carensac
178 18 Paul Carensac
    * Created agent.py whith a "class AlertManagerAgent(Agent):" inside
179 18 Paul Carensac
    * Overriding agent's 'work' and 'shutdown' method
180 18 Paul Carensac
    * Added message(s) to agent.actions_by_message dictionnary, with the functions associated to these messages
181 18 Paul Carensac
    * Added the Agent's launch system in apps.py
182 18 Paul Carensac
 
183 18 Paul Carensac
 * Implementation of the VOEventListener Thread
184 18 Paul Carensac
185 18 Paul Carensac
    * Created a "class VOEventListener(Thread):" in agent.py
186 18 Paul Carensac
    * Overriding the run method
187 18 Paul Carensac
188 27 Paul Carensac
 * 19/05/2016 : deleted the agent system (deleted from the applications above too)
189 1 Paul Carensac
190 27 Paul Carensac
 * Added some VOEvents in events_to_send
191 27 Paul Carensac
192 27 Paul Carensac
 * Installed Comet (see in [[Technical components]] section)
193 27 Paul Carensac
194 27 Paul Carensac
h3. Notes
195 18 Paul Carensac
196 18 Paul Carensac
h3. TODO
197 18 Paul Carensac
198 18 Paul Carensac
199 18 Paul Carensac
---
200 18 Paul Carensac
201 20 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}analyzer%
202 18 Paul Carensac
203 18 Paul Carensac
h3. Purpose
204 18 Paul Carensac
205 18 Paul Carensac
 * Analyze the images taken by the observation manager
206 18 Paul Carensac
207 18 Paul Carensac
h3. Evolution
208 18 Paul Carensac
209 18 Paul Carensac
 * Creating application
210 18 Paul Carensac
211 18 Paul Carensac
    * See scheduler documentation above
212 18 Paul Carensac
213 18 Paul Carensac
 * Implementation of the agent system
214 18 Paul Carensac
215 18 Paul Carensac
    * See alert_manager above
216 18 Paul Carensac
    * 'shutdown' method is not implemented here because the Agent's default one is enough 
217 18 Paul Carensac
218 18 Paul Carensac
h3. Notes
219 18 Paul Carensac
220 18 Paul Carensac
h3. TODO
221 18 Paul Carensac
222 18 Paul Carensac
---
223 18 Paul Carensac
224 19 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}majordome%
225 18 Paul Carensac
226 18 Paul Carensac
h3. Purpose
227 18 Paul Carensac
228 18 Paul Carensac
h3. Evolution
229 18 Paul Carensac
230 18 Paul Carensac
 * Creating application
231 18 Paul Carensac
232 18 Paul Carensac
    * See scheduler documentation above
233 18 Paul Carensac
234 21 Paul Carensac
 * Implementation of the agent system
235 1 Paul Carensac
236 21 Paul Carensac
    * See alert_manager above
237 21 Paul Carensac
238 21 Paul Carensac
 * Implementation of the MajordomeExecutor Thread
239 21 Paul Carensac
240 21 Paul Carensac
    * Created a "class MajordomeExecutor(Thread):" in agent.py
241 21 Paul Carensac
    * Overriding the run method
242 21 Paul Carensac
243 21 Paul Carensac
244 18 Paul Carensac
h3. Notes
245 18 Paul Carensac
246 18 Paul Carensac
h3. TODO
247 18 Paul Carensac
248 18 Paul Carensac
---
249 18 Paul Carensac
250 19 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}monitoring%
251 18 Paul Carensac
252 18 Paul Carensac
h3. Purpose
253 18 Paul Carensac
254 18 Paul Carensac
h3. Evolution
255 18 Paul Carensac
256 18 Paul Carensac
 * Creating application
257 1 Paul Carensac
258 18 Paul Carensac
    * See scheduler documentation above
259 1 Paul Carensac
260 21 Paul Carensac
 * Implementation of the agent system
261 1 Paul Carensac
262 21 Paul Carensac
    * See alert_manager above
263 21 Paul Carensac
    * 'shutdown' method is not implemented here because the Agent's default one is enough 
264 21 Paul Carensac
265 18 Paul Carensac
 
266 18 Paul Carensac
h3. Notes
267 18 Paul Carensac
268 18 Paul Carensac
h3. TODO
269 18 Paul Carensac
270 18 Paul Carensac
---
271 19 Paul Carensac
272 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}observation_manager%
273 18 Paul Carensac
274 18 Paul Carensac
h3. Purpose
275 18 Paul Carensac
276 18 Paul Carensac
h3. Evolution
277 18 Paul Carensac
278 1 Paul Carensac
 * Creating application
279 18 Paul Carensac
280 1 Paul Carensac
    * See scheduler documentation above
281 1 Paul Carensac
282 21 Paul Carensac
 * Implementation of the agent system
283 1 Paul Carensac
284 21 Paul Carensac
    * See alert_manager above
285 21 Paul Carensac
286 21 Paul Carensac
 * Implementation of the ObservationExecutor Thread
287 21 Paul Carensac
288 21 Paul Carensac
    * Created a "class ObservationExecutor(Thread):" in agent.py
289 21 Paul Carensac
    * Overriding the run method
290 21 Paul Carensac
291 18 Paul Carensac
 
292 18 Paul Carensac
h3. Notes
293 18 Paul Carensac
294 18 Paul Carensac
h3. TODO
295 18 Paul Carensac
296 19 Paul Carensac
---
297 18 Paul Carensac
298 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}request_builder%
299 18 Paul Carensac
300 18 Paul Carensac
h3. Purpose
301 18 Paul Carensac
302 18 Paul Carensac
h3. Evolution
303 18 Paul Carensac
304 18 Paul Carensac
 * Creating application
305 18 Paul Carensac
306 18 Paul Carensac
    * See scheduler documentation above
307 18 Paul Carensac
308 18 Paul Carensac
 
309 18 Paul Carensac
h3. Notes
310 18 Paul Carensac
311 18 Paul Carensac
h3. TODO
312 18 Paul Carensac
313 19 Paul Carensac
---
314 18 Paul Carensac
315 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}routine_manager%
316 18 Paul Carensac
317 18 Paul Carensac
h3. Purpose
318 18 Paul Carensac
319 18 Paul Carensac
h3. Evolution
320 18 Paul Carensac
321 18 Paul Carensac
 * Creating application
322 18 Paul Carensac
323 18 Paul Carensac
    * See scheduler documentation above
324 18 Paul Carensac
325 18 Paul Carensac
 
326 18 Paul Carensac
h3. Notes
327 18 Paul Carensac
328 18 Paul Carensac
h3. TODO
329 18 Paul Carensac
330 19 Paul Carensac
---
331 18 Paul Carensac
332 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}user_manager%
333 18 Paul Carensac
334 18 Paul Carensac
h3. Purpose
335 18 Paul Carensac
336 18 Paul Carensac
h3. Evolution
337 18 Paul Carensac
338 18 Paul Carensac
 * Creating application
339 18 Paul Carensac
340 18 Paul Carensac
    * See scheduler documentation above
341 18 Paul Carensac
342 18 Paul Carensac
 
343 18 Paul Carensac
h3. Notes
344 18 Paul Carensac
345 18 Paul Carensac
h3. TODO
346 18 Paul Carensac
347 18 Paul Carensac
---
348 18 Paul Carensac
349 20 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}common%
350 18 Paul Carensac
351 18 Paul Carensac
h3. Purpose
352 18 Paul Carensac
353 18 Paul Carensac
 * Regroups common data and functions shared by applications
354 18 Paul Carensac
355 18 Paul Carensac
h3. Content
356 18 Paul Carensac
357 25 Paul Carensac
 * RequestBuilder - class to build and save in DB the requests
358 18 Paul Carensac
359 25 Paul Carensac
  * You can start a request, then add sequences, albums and plans, given their parent class (ex: you need to give a sequence id to create an album)
360 25 Paul Carensac
  * Each function returns the ID of the element it created (to give it to the children classes)
361 25 Paul Carensac
  * To save a request, you need to use validate_request
362 18 Paul Carensac
 
363 18 Paul Carensac
h3. Notes
364 25 Paul Carensac
365 25 Paul Carensac
 * Will probably contain the DB models at last ...
366 18 Paul Carensac
367 18 Paul Carensac
h3. TODO