]> Humopery - polarsbop.git/log
polarsbop.git
2 years agoBox<dyn Error> not custom error
Erik Mackdanz [Wed, 29 Nov 2023 09:13:05 +0000 (03:13 -0600)]
Box<dyn Error> not custom error

2 years agofor reduce, download partitions to local filesystem
Erik Mackdanz [Wed, 29 Nov 2023 04:36:09 +0000 (22:36 -0600)]
for reduce, download partitions to local filesystem

Also implement a custom error

2 years agostub reduce_bucket
Erik Mackdanz [Tue, 28 Nov 2023 12:50:15 +0000 (06:50 -0600)]
stub reduce_bucket

2 years agoadd mapbucket command arg
Erik Mackdanz [Tue, 28 Nov 2023 12:36:26 +0000 (06:36 -0600)]
add mapbucket command arg

2 years agooutput to buckets based on Primary Income
Erik Mackdanz [Tue, 28 Nov 2023 06:06:22 +0000 (00:06 -0600)]
output to buckets based on Primary Income

2 years agoattempt streaming
Erik Mackdanz [Mon, 27 Nov 2023 04:22:58 +0000 (22:22 -0600)]
attempt streaming

2 years agoconvert eager df to lazy df
Erik Mackdanz [Sun, 26 Nov 2023 14:54:15 +0000 (08:54 -0600)]
convert eager df to lazy df

2 years agowrite to s3
Erik Mackdanz [Sat, 25 Nov 2023 14:49:41 +0000 (08:49 -0600)]
write to s3

2 years agothree partitions not two
Erik Mackdanz [Sat, 25 Nov 2023 03:40:15 +0000 (21:40 -0600)]
three partitions not two

2 years agouse expect() not unwrap()
Erik Mackdanz [Sat, 25 Nov 2023 03:02:00 +0000 (21:02 -0600)]
use expect() not unwrap()

2 years agorename year col
Erik Mackdanz [Fri, 24 Nov 2023 18:03:53 +0000 (12:03 -0600)]
rename year col

2 years agoparallelize to split output
Erik Mackdanz [Fri, 24 Nov 2023 17:56:00 +0000 (11:56 -0600)]
parallelize to split output

2 years ago? not unwrap
Erik Mackdanz [Fri, 24 Nov 2023 05:40:35 +0000 (23:40 -0600)]
? not unwrap

2 years agoUse full BOP data set
Erik Mackdanz [Fri, 24 Nov 2023 05:24:33 +0000 (23:24 -0600)]
Use full BOP data set

2 years agowrite json
Erik Mackdanz [Fri, 24 Nov 2023 04:25:50 +0000 (22:25 -0600)]
write json

2 years agosome basic manipulations
Erik Mackdanz [Thu, 23 Nov 2023 20:47:22 +0000 (14:47 -0600)]
some basic manipulations

2 years agodebug print CSV
Erik Mackdanz [Thu, 23 Nov 2023 18:48:45 +0000 (12:48 -0600)]
debug print CSV

2 years agoempty
Erik Mackdanz [Thu, 23 Nov 2023 16:46:16 +0000 (10:46 -0600)]
empty