~jgillis/apache-arrow-reading-writing

84857469 — Joris Gillis 4 years ago master
License text
2e333fb3 — Joris Gillis 4 years ago
Adds README.md
56fdafe5 — Joris Gillis 4 years ago
Single column filter & ByteString

Adds an application to use even fewer columns of the dataset
Use ByteString from okio library to work with byte[] representation of String
d2b196f2 — Joris Gillis 4 years ago
Reformatting code
bec00dec — Joris Gillis 4 years ago
Extracted and abstracted ChunkedWriter

Extracting the chunking logic into a separate class.
Introduces Vectorizer to convert an object into a set of entries in a VectorSchemaRoot
cd57ce53 — Joris Gillis 4 years ago
Simplifying fetching vector from StructVector
3d40952d — Joris Gillis 4 years ago
Using autocloseable
c482fa5f — Joris Gillis 4 years ago
Upgrading arrow to latest version 0.16.0
76707865 — Joris Gillis 4 years ago
Removing gender from person object

Based on article review, removed gender from the Person object
Repurposed the aggregation to city. Now, we need to use a regular Map,
with all autoboxing issues, as there is no FastUtil for String -> Long
a52505fc — Joris Gillis 4 years ago
Renaming package
cc9f49e0 — Joris Gillis 4 years ago
Reading Application
887ea59f — Joris Gillis 4 years ago
Improving writing application

Make sure there are last names starting with a P :-)
Add timing to writing process
Ensure clean up of memory (buffers)
d2d45a2a — Joris Gillis 4 years ago
Writing application
9f629af6 — Joris Gillis 4 years ago
Initial commit