Garrick Aden-Buie
87bca76b78
`cover` table should have distinct rows, fill in missing covers
3 jaren geleden
Garrick Aden-Buie
9aa81ea812
faster data collection setup
3 jaren geleden
Garrick Aden-Buie
120702d2ae
track collect/data-raw/report_list.csv
3 jaren geleden
Garrick Aden-Buie
7a2cef064a
fix a bug in report processing
transposing the list would silently drop list elements
3 jaren geleden
Garrick Aden-Buie
8be009d5cf
move reports into subdirs
3 jaren geleden
Garrick Aden-Buie
fac27f746b
status and collection process update reports
3 jaren geleden
Garrick Aden-Buie
f6e8c9deda
finish process
3 jaren geleden
Garrick Aden-Buie
7b988094ca
read in report exports
3 jaren geleden
Garrick Aden-Buie
8593c43fbe
process raw data in a new project
3 jaren geleden
Garrick Aden-Buie
70369dd98b
move data collection into subfolder
3 jaren geleden
Garrick Aden-Buie
c87a804c04
getting receipts and expenditures worked out
3 jaren geleden
Garrick Aden-Buie
23d145fb5d
trying to parse the badly formatted csvs
3 jaren geleden
Garrick Aden-Buie
df7d8d347b
prepping to read into parquet format
3 jaren geleden
Garrick Aden-Buie
3f6def269c
reorganize targets an ensure up to date
3 jaren geleden
Garrick Aden-Buie
3299e98daf
ignore data-raw folder
3 jaren geleden
Garrick Aden-Buie
261a6f5837
rework pipeline to locally store complete report as raw text
3 jaren geleden
Garrick Aden-Buie
83b9d4d169
udpate gitignore
3 jaren geleden
Garrick Aden-Buie
da3eadc747
getting report sections, fixed getting document list
3 jaren geleden
Garrick Aden-Buie
f7eb2a291c
track committee list
3 jaren geleden
Garrick Aden-Buie
1f1bd52d9f
get document list for all committees since 2016
* Finds all relevant reporting docs for all committees
* This data doesn't have the link to the actual report data,
but it does give us SBOE ID, which will lead us to the right place.
3 jaren geleden