user:kluong:improvement_-_simplified_data_pipeline

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
user:kluong:improvement_-_simplified_data_pipeline [2021/03/29 15:02]
kluong
user:kluong:improvement_-_simplified_data_pipeline [2021/10/07 14:04] (current)
kluong
Line 2: Line 2:
  
 **Note: this page is in draft.** **Note: this page is in draft.**
 +
 +
 +===== Background/​Motivation =====
  
 There'​s a bit of complexity around how handle sensor data. Here are two things: There'​s a bit of complexity around how handle sensor data. Here are two things:
Line 11: Line 14:
  
 One limitation with XBees + ZigBee is that packets can only carry a payload of 72 bytes. One limitation with XBees + ZigBee is that packets can only carry a payload of 72 bytes.
 +
 +There is the added benefit that 296 teams should also be able to easily construct these packets and send to the gateway as well.
  
 Here's what I think should change: Here's what I think should change:
Line 19: Line 24:
 More thoughts here More thoughts here
  
-* https://​wiki.scel-hawaii.org/​doku.php?​id=user:​kluong:​thinking_about_a_generic_schema+  ​* https://​wiki.scel-hawaii.org/​doku.php?​id=user:​kluong:​thinking_about_a_generic_schema 
 + 
 + 
 +===== Implementation ===== 
 + 
 +  * Go through tasks, put it onto a google doc for collaboration / documentation 
 +    * make sure the initial background and motivation are documented as well 
 +  * Come up with a new simplified schema 
 +  * Create an SQL file (or migration script) to add the new table 
 +  * Test this new table locally 
 +  * Migrate the gateway to store all packets into this unified table 
 +  * Deploy the gateway to staging to test it 
 +  * Deploy the gateway to production 
 +  * Change the firmware to use the new format 
 +  * Deploy firmware on boxes 
 + 
 + 
  • user/kluong/improvement_-_simplified_data_pipeline.1617030174.txt.gz
  • Last modified: 2021/09/19 21:59
  • (external edit)