nc-campaign-finance

Commit graph

Autor	SHA1	Nachricht	Datum
Garrick Aden-Buie	e1dcb0667f	update reports	vor 2 Jahren
Garrick Aden-Buie	35f3a9a847	sort report list by report_id	vor 2 Jahren
Garrick Aden-Buie	5478feb4c0	easier method to load prepped data from parquet to duckdb tables	vor 2 Jahren
Garrick Aden-Buie	23690d6c76	progress before pause	vor 2 Jahren
Garrick Aden-Buie	1f8f26ce30	task: table of committees	vor 3 Jahren
Garrick Aden-Buie	7901dc4920	break process into two steps: prepare and process; pick final report	vor 3 Jahren
Garrick Aden-Buie	2ae2575005	fix: save result of table post-processing	vor 3 Jahren
Garrick Aden-Buie	422727b68d	need to know fixed sboe_id when writing out the parquet files	vor 3 Jahren
Garrick Aden-Buie	070e95a120	fix missing sboe_id values that are "No Id" in the database By filling these in with `NOID-{report_id}`. This creates a unique sboe_id for the committee for the report, otherwise all "No Id" committees would end up being impossible to differentiate.	vor 3 Jahren
Garrick Aden-Buie	9a1c6642e3	add validation/exploration script	vor 3 Jahren
Garrick Aden-Buie	31ab569fd8	add `cf_db_create()`	vor 3 Jahren
Garrick Aden-Buie	87bca76b78	`cover` table should have distinct rows, fill in missing covers	vor 3 Jahren
Garrick Aden-Buie	9aa81ea812	faster data collection setup	vor 3 Jahren
Garrick Aden-Buie	120702d2ae	track collect/data-raw/report_list.csv	vor 3 Jahren
Garrick Aden-Buie	7a2cef064a	fix a bug in report processing transposing the list would silently drop list elements	vor 3 Jahren
Garrick Aden-Buie	8be009d5cf	move reports into subdirs	vor 3 Jahren
Garrick Aden-Buie	fac27f746b	status and collection process update reports	vor 3 Jahren
Garrick Aden-Buie	f6e8c9deda	finish process	vor 3 Jahren
Garrick Aden-Buie	7b988094ca	read in report exports	vor 3 Jahren
Garrick Aden-Buie	8593c43fbe	process raw data in a new project	vor 3 Jahren
Garrick Aden-Buie	70369dd98b	move data collection into subfolder	vor 3 Jahren
Garrick Aden-Buie	c87a804c04	getting receipts and expenditures worked out	vor 3 Jahren
Garrick Aden-Buie	23d145fb5d	trying to parse the badly formatted csvs	vor 3 Jahren
Garrick Aden-Buie	df7d8d347b	prepping to read into parquet format	vor 3 Jahren
Garrick Aden-Buie	3f6def269c	reorganize targets an ensure up to date	vor 3 Jahren
Garrick Aden-Buie	3299e98daf	ignore data-raw folder	vor 3 Jahren
Garrick Aden-Buie	261a6f5837	rework pipeline to locally store complete report as raw text	vor 3 Jahren
Garrick Aden-Buie	83b9d4d169	udpate gitignore	vor 3 Jahren
Garrick Aden-Buie	da3eadc747	getting report sections, fixed getting document list	vor 3 Jahren
Garrick Aden-Buie	f7eb2a291c	track committee list	vor 3 Jahren
Garrick Aden-Buie	1f1bd52d9f	get document list for all committees since 2016 * Finds all relevant reporting docs for all committees * This data doesn't have the link to the actual report data, but it does give us SBOE ID, which will lead us to the right place.	vor 3 Jahren

31 Commits (e1dcb0667fe998f8605895d25e2526d20acff946) Alle Branches Suchen

31 Commits (e1dcb0667fe998f8605895d25e2526d20acff946)

Alle Branches