Pyros applications

Version 23 (Paul Carensac, 05/19/2016 03:34 pm)

1 1 Paul Carensac
h1. Pyros applications
2 1 Paul Carensac
3 2 Paul Carensac
List and details of all the pyros applications.
4 2 Paul Carensac
5 17 Paul Carensac
{{>toc}}
6 17 Paul Carensac
7 2 Paul Carensac
---
8 2 Paul Carensac
9 2 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}pyrosapp%
10 2 Paul Carensac
11 3 Paul Carensac
h3. Purpose
12 2 Paul Carensac
13 2 Paul Carensac
 * Contains all the database Models
14 2 Paul Carensac
 * Basic tests in tests.py
15 2 Paul Carensac
 * Backoffice configuration in admin.py
16 2 Paul Carensac
17 3 Paul Carensac
h3. Notes
18 2 Paul Carensac
19 2 Paul Carensac
 * Will be progressively deleted while models being displaced
20 2 Paul Carensac
21 2 Paul Carensac
---
22 2 Paul Carensac
23 2 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}dashboard%
24 2 Paul Carensac
25 3 Paul Carensac
h3. Purpose
26 2 Paul Carensac
27 2 Paul Carensac
 * Interface for all external users
28 2 Paul Carensac
 * Leads to displays and actions for all the pyros modules (users, requests, system execution, ...)
29 2 Paul Carensac
30 4 Paul Carensac
h3. Evolution
31 4 Paul Carensac
32 4 Paul Carensac
 * Creating application
33 4 Paul Carensac
34 4 Paul Carensac
    * manage.py startapp dashboard
35 5 Paul Carensac
    * added 'dashboard' in settings.py -> INSTALLED_APPS
36 5 Paul Carensac
    * created a urls.py file in dashboard module
37 5 Paul Carensac
    * added _url(r'^dashboard/', include('dashboard.urls'))_ in pyros/urls.py -> urlpatterns
38 5 Paul Carensac
    * created templates/ and templates/dashboard/ folders in dashboard module
39 5 Paul Carensac
40 5 Paul Carensac
 * Main page
41 5 Paul Carensac
42 5 Paul Carensac
    * added 'home' view in views.py
43 5 Paul Carensac
    * linked 'home' view to 8000/dashboard URL
44 5 Paul Carensac
    * created a template for the homepage in templates/dashboard/ (with bootstrap)
45 5 Paul Carensac
    * created views, views linking (urls.py) and templates for the dashboard modules
46 5 Paul Carensac
    * redirected mainpage buttons to Admin interface (temporary)
47 4 Paul Carensac
48 22 Paul Carensac
 * System page (logs)
49 22 Paul Carensac
50 22 Paul Carensac
    * Retrieve logs from the db
51 22 Paul Carensac
    * Print logs and automatically update via an ajax request
52 22 Paul Carensac
53 3 Paul Carensac
h3. Notes
54 2 Paul Carensac
55 2 Paul Carensac
 * The buttons lead to the Admin interface for the moment
56 7 Paul Carensac
 * Added bootstrap3 module (see Installation)
57 7 Paul Carensac
 * Added Django Template Editor (see Eclipse configuration)
58 2 Paul Carensac
59 3 Paul Carensac
h3. TODO
60 2 Paul Carensac
61 2 Paul Carensac
 * Create the backoffice views as the modules are integrated in pyros
62 2 Paul Carensac
 * Think about a system of permissions
63 2 Paul Carensac
64 2 Paul Carensac
---
65 8 Paul Carensac
66 8 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}scheduler%
67 8 Paul Carensac
68 8 Paul Carensac
h3. Purpose
69 8 Paul Carensac
70 8 Paul Carensac
 * Creates the planning with the OBSERVABLE sequences
71 8 Paul Carensac
 * Give acces to a web page to see the current planning
72 8 Paul Carensac
73 8 Paul Carensac
h3. Evolution
74 8 Paul Carensac
75 8 Paul Carensac
 * Creating application
76 8 Paul Carensac
77 8 Paul Carensac
    * manage.py startapp scheduler
78 8 Paul Carensac
    * added 'scheduler' in settings.py -> INSTALLED_APPS
79 8 Paul Carensac
    * created a urls.py file in scheduler module
80 8 Paul Carensac
    * added _url(r'^scheduler/', include('scheduler.urls'))_ in pyros/urls.py -> urlpatterns
81 8 Paul Carensac
    * created templates/ and templates/scheduler/ folders in scheduler module
82 8 Paul Carensac
83 9 Paul Carensac
 * Model modifications
84 1 Paul Carensac
85 9 Paul Carensac
    * Schedule
86 9 Paul Carensac
87 9 Paul Carensac
        * Remove day_start
88 9 Paul Carensac
        * Remove day_stop
89 9 Paul Carensac
        * Add plan_start
90 13 Paul Carensac
        * Add plan_end
91 9 Paul Carensac
        * Enum system for the status 
92 9 Paul Carensac
    * ScheduleHistory
93 9 Paul Carensac
94 9 Paul Carensac
        * Remove day_start
95 9 Paul Carensac
        * Remove day_stop
96 9 Paul Carensac
        * Add plan_start
97 13 Paul Carensac
        * Add plan_end
98 9 Paul Carensac
    * Sequence
99 9 Paul Carensac
100 9 Paul Carensac
        * Remove exec_start
101 9 Paul Carensac
        * Remove exec_stop
102 9 Paul Carensac
        * Add tsp
103 9 Paul Carensac
        * Add tep
104 9 Paul Carensac
        * Add jd1
105 9 Paul Carensac
        * Add jd2
106 9 Paul Carensac
        * Add deltaTL
107 9 Paul Carensac
        * Add deltaTR
108 9 Paul Carensac
        * Add t_prefered
109 9 Paul Carensac
        * Changed duration from Float to DecimalField (more precise)
110 15 Paul Carensac
        * Add overhead
111 15 Paul Carensac
112 10 Paul Carensac
    * manage.py makemigrations sheduler ; manage.py migrate
113 10 Paul Carensac
114 10 Paul Carensac
 * Creation of Scheduler and Interval classes in models.py
115 10 Paul Carensac
116 10 Paul Carensac
 * Implementation of the Interval class
117 10 Paul Carensac
118 12 Paul Carensac
 * Implementation of the Scheduler's 'make_schedule' function (and children). This is the only entry point for now. This function creates the planning (organizes the observable sequences).
119 9 Paul Carensac
120 14 Paul Carensac
 * Creation of the web interface
121 14 Paul Carensac
122 14 Paul Carensac
    * Added current_schedule.html in template/scheduler folder
123 14 Paul Carensac
    * Created view and url linking to this template (with current planning retrieving)
124 14 Paul Carensac
125 14 Paul Carensac
 * Creation of the simulator
126 14 Paul Carensac
127 14 Paul Carensac
    * Created a second entry point in the Scheduler class (with a few minor adaptations to handle SIMULATION mode)
128 14 Paul Carensac
    * Created a simulator module in the scheduler
129 14 Paul Carensac
        
130 14 Paul Carensac
        * Added the MyHTMLParser class (easy implementation of HTMLParser)
131 23 Paul Carensac
        * Added Simulator class. It parses a file given in parametr to retrieve sequences and create a schedule
132 14 Paul Carensac
    * Created a second view linked to schedule/simulation to show simulation results
133 1 Paul Carensac
 
134 23 Paul Carensac
 * Main update 19/05/2016 : overheads & historic system
135 23 Paul Carensac
136 23 Paul Carensac
    * Deleted ScheduleHistory
137 23 Paul Carensac
    * Transformed the Sequence - Schedule relation to ManyToMany
138 23 Paul Carensac
    * Moved the scheduling information into the M2M relationship class (shs = ScheduleHasSequences)
139 23 Paul Carensac
    * Added a static overhead into scheduling (can be set from the calling code, through scheduler.max_overhead = blabla(float))
140 23 Paul Carensac
141 23 Paul Carensac
h3. Tests
142 23 Paul Carensac
143 8 Paul Carensac
h3. Notes
144 1 Paul Carensac
145 1 Paul Carensac
 * Priorities and quotas are default-calculated (for the moment)
146 9 Paul Carensac
 * What is the 'flag' attribute in the Schedule model ?
147 1 Paul Carensac
148 9 Paul Carensac
h3. TODO
149 13 Paul Carensac
150 9 Paul Carensac
 * Determine plan_start & plan_end
151 9 Paul Carensac
 * Priority and quota computing
152 1 Paul Carensac
 * Re-scheduling
153 9 Paul Carensac
 * Blank space filling
154 23 Paul Carensac
 * Change t_prefered handling (place in nearest interval instead of first-before)
155 18 Paul Carensac
156 18 Paul Carensac
---
157 18 Paul Carensac
158 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}alert_manager%
159 18 Paul Carensac
160 18 Paul Carensac
h3. Purpose
161 18 Paul Carensac
162 18 Paul Carensac
 * Listen to VOEvent network
163 18 Paul Carensac
 * Sort interesting events
164 18 Paul Carensac
 * Create requests according to these events
165 18 Paul Carensac
 * Manage the requests created via the alerts
166 18 Paul Carensac
167 18 Paul Carensac
h3. Evolution
168 18 Paul Carensac
169 18 Paul Carensac
 * Creating application
170 18 Paul Carensac
171 18 Paul Carensac
    * See scheduler documentation above
172 18 Paul Carensac
173 18 Paul Carensac
 * Implementation of the agent system
174 18 Paul Carensac
175 18 Paul Carensac
    * Created agent.py whith a "class AlertManagerAgent(Agent):" inside
176 18 Paul Carensac
    * Overriding agent's 'work' and 'shutdown' method
177 18 Paul Carensac
    * Added message(s) to agent.actions_by_message dictionnary, with the functions associated to these messages
178 18 Paul Carensac
    * Added the Agent's launch system in apps.py
179 18 Paul Carensac
 
180 18 Paul Carensac
 * Implementation of the VOEventListener Thread
181 18 Paul Carensac
182 18 Paul Carensac
    * Created a "class VOEventListener(Thread):" in agent.py
183 18 Paul Carensac
    * Overriding the run method
184 18 Paul Carensac
185 18 Paul Carensac
h3. Notes
186 18 Paul Carensac
187 18 Paul Carensac
 * No functionnality is implemented
188 18 Paul Carensac
189 18 Paul Carensac
h3. TODO
190 18 Paul Carensac
191 18 Paul Carensac
192 18 Paul Carensac
---
193 18 Paul Carensac
194 20 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}analyzer%
195 18 Paul Carensac
196 18 Paul Carensac
h3. Purpose
197 18 Paul Carensac
198 18 Paul Carensac
 * Analyze the images taken by the observation manager
199 18 Paul Carensac
200 18 Paul Carensac
h3. Evolution
201 18 Paul Carensac
202 18 Paul Carensac
 * Creating application
203 18 Paul Carensac
204 18 Paul Carensac
    * See scheduler documentation above
205 18 Paul Carensac
206 18 Paul Carensac
 * Implementation of the agent system
207 18 Paul Carensac
208 18 Paul Carensac
    * See alert_manager above
209 18 Paul Carensac
    * 'shutdown' method is not implemented here because the Agent's default one is enough 
210 18 Paul Carensac
211 18 Paul Carensac
h3. Notes
212 18 Paul Carensac
213 18 Paul Carensac
h3. TODO
214 18 Paul Carensac
215 18 Paul Carensac
---
216 18 Paul Carensac
217 19 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}majordome%
218 18 Paul Carensac
219 18 Paul Carensac
h3. Purpose
220 18 Paul Carensac
221 18 Paul Carensac
h3. Evolution
222 18 Paul Carensac
223 18 Paul Carensac
 * Creating application
224 18 Paul Carensac
225 18 Paul Carensac
    * See scheduler documentation above
226 18 Paul Carensac
227 21 Paul Carensac
 * Implementation of the agent system
228 1 Paul Carensac
229 21 Paul Carensac
    * See alert_manager above
230 21 Paul Carensac
231 21 Paul Carensac
 * Implementation of the MajordomeExecutor Thread
232 21 Paul Carensac
233 21 Paul Carensac
    * Created a "class MajordomeExecutor(Thread):" in agent.py
234 21 Paul Carensac
    * Overriding the run method
235 21 Paul Carensac
236 21 Paul Carensac
237 18 Paul Carensac
h3. Notes
238 18 Paul Carensac
239 18 Paul Carensac
h3. TODO
240 18 Paul Carensac
241 18 Paul Carensac
---
242 18 Paul Carensac
243 19 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}monitoring%
244 18 Paul Carensac
245 18 Paul Carensac
h3. Purpose
246 18 Paul Carensac
247 18 Paul Carensac
h3. Evolution
248 18 Paul Carensac
249 18 Paul Carensac
 * Creating application
250 1 Paul Carensac
251 18 Paul Carensac
    * See scheduler documentation above
252 1 Paul Carensac
253 21 Paul Carensac
 * Implementation of the agent system
254 1 Paul Carensac
255 21 Paul Carensac
    * See alert_manager above
256 21 Paul Carensac
    * 'shutdown' method is not implemented here because the Agent's default one is enough 
257 21 Paul Carensac
258 18 Paul Carensac
 
259 18 Paul Carensac
h3. Notes
260 18 Paul Carensac
261 18 Paul Carensac
h3. TODO
262 18 Paul Carensac
263 18 Paul Carensac
---
264 19 Paul Carensac
265 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}observation_manager%
266 18 Paul Carensac
267 18 Paul Carensac
h3. Purpose
268 18 Paul Carensac
269 18 Paul Carensac
h3. Evolution
270 18 Paul Carensac
271 1 Paul Carensac
 * Creating application
272 18 Paul Carensac
273 1 Paul Carensac
    * See scheduler documentation above
274 1 Paul Carensac
275 21 Paul Carensac
 * Implementation of the agent system
276 1 Paul Carensac
277 21 Paul Carensac
    * See alert_manager above
278 21 Paul Carensac
279 21 Paul Carensac
 * Implementation of the ObservationExecutor Thread
280 21 Paul Carensac
281 21 Paul Carensac
    * Created a "class ObservationExecutor(Thread):" in agent.py
282 21 Paul Carensac
    * Overriding the run method
283 21 Paul Carensac
284 18 Paul Carensac
 
285 18 Paul Carensac
h3. Notes
286 18 Paul Carensac
287 18 Paul Carensac
h3. TODO
288 18 Paul Carensac
289 19 Paul Carensac
---
290 18 Paul Carensac
291 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}request_builder%
292 18 Paul Carensac
293 18 Paul Carensac
h3. Purpose
294 18 Paul Carensac
295 18 Paul Carensac
h3. Evolution
296 18 Paul Carensac
297 18 Paul Carensac
 * Creating application
298 18 Paul Carensac
299 18 Paul Carensac
    * See scheduler documentation above
300 18 Paul Carensac
301 18 Paul Carensac
 
302 18 Paul Carensac
h3. Notes
303 18 Paul Carensac
304 18 Paul Carensac
h3. TODO
305 18 Paul Carensac
306 19 Paul Carensac
---
307 18 Paul Carensac
308 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}routine_manager%
309 18 Paul Carensac
310 18 Paul Carensac
h3. Purpose
311 18 Paul Carensac
312 18 Paul Carensac
h3. Evolution
313 18 Paul Carensac
314 18 Paul Carensac
 * Creating application
315 18 Paul Carensac
316 18 Paul Carensac
    * See scheduler documentation above
317 18 Paul Carensac
318 18 Paul Carensac
 
319 18 Paul Carensac
h3. Notes
320 18 Paul Carensac
321 18 Paul Carensac
h3. TODO
322 18 Paul Carensac
323 19 Paul Carensac
---
324 18 Paul Carensac
325 18 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}user_manager%
326 18 Paul Carensac
327 18 Paul Carensac
h3. Purpose
328 18 Paul Carensac
329 18 Paul Carensac
h3. Evolution
330 18 Paul Carensac
331 18 Paul Carensac
 * Creating application
332 18 Paul Carensac
333 18 Paul Carensac
    * See scheduler documentation above
334 18 Paul Carensac
335 18 Paul Carensac
 
336 18 Paul Carensac
h3. Notes
337 18 Paul Carensac
338 18 Paul Carensac
h3. TODO
339 18 Paul Carensac
340 18 Paul Carensac
---
341 18 Paul Carensac
342 20 Paul Carensac
h2. %{margin-left:0px; font-weight:bold; font-size:25px;  display:block; color:red;}common%
343 18 Paul Carensac
344 18 Paul Carensac
h3. Purpose
345 18 Paul Carensac
346 18 Paul Carensac
 * Regroups common data and functions shared by applications
347 18 Paul Carensac
348 18 Paul Carensac
h3. Content
349 18 Paul Carensac
350 18 Paul Carensac
 * Agent system in agent.py
351 18 Paul Carensac
352 18 Paul Carensac
    * Class to be overrode by every agent
353 18 Paul Carensac
    * Defines the agent names and status
354 18 Paul Carensac
355 18 Paul Carensac
 * Agents configuration in pyros_agent_config.ini
356 18 Paul Carensac
357 18 Paul Carensac
    * Defines the agents name, receiving port and ip
358 18 Paul Carensac
359 18 Paul Carensac
 * Sender system in sender.py
360 18 Paul Carensac
361 18 Paul Carensac
    * static send_to function, to send messages to the agents
362 18 Paul Carensac
363 18 Paul Carensac
 * Common tests in test.py
364 18 Paul Carensac
365 18 Paul Carensac
    * Class AgentTests to test agents' functionnalities
366 18 Paul Carensac
 
367 18 Paul Carensac
h3. Notes
368 18 Paul Carensac
369 18 Paul Carensac
h3. TODO