Skip to content

Commit

Permalink
Manifest driven downloads (#117)
Browse files Browse the repository at this point in the history
* Add manifest and logic to precompute the minimal dataset file list before download.

* Change maxx, maxy to xmax, ymax, etc.

* Update to july catalog for further testing.

* Lift the theme enablement state up to the App level and plumb it to the download button.

* Get the download catalog to honor the visible themes, discarding ones that aren't visible.

* Update download catalog generation to return a base path and list of filespecs relative to that basepath.

* Split download file catalog by type, and download one file per type using concurrent promise pipelining.

* Rebase this branch on top of main, and pick up the latest manifest for the 09-18 release.

* Fix #168 but only writing tables to files if there are any batch records to speak of.

* Trigger deploy

* Update package-lock file.

* Update geoparquet to support downloads.

* Fix the download bbox path specs to conform to the latest geoparquet-wasm release.

* Update the download manifest to point to the november release.

* Remove the beta labelling from the wordmark. It's time for GA, Bay-bee

* Fix formatting as per PR feedback.

* Add a simple catch statement to alert the user when the download goes awry.

* Move manifests into their own folder.

---------

Co-authored-by: Benjamin Clark <clarkben@meta.com>
  • Loading branch information
Bonkles and Benjamin Clark authored Dec 18, 2024
1 parent 4327f39 commit 4fbdbf8
Show file tree
Hide file tree
Showing 12 changed files with 16,522 additions and 277 deletions.
6 changes: 6 additions & 0 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion site/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
"dependencies": {
"@emotion/react": "^11.11.4",
"@emotion/styled": "^11.11.5",
"@geoarrow/geoarrow-wasm": "^0.2.0-beta.4",
"@geoarrow/geoarrow-wasm": "^0.2.0-beta.5",
"@mui/base": "^5.0.0-beta.40",
"@mui/icons-material": "^5.15.21",
"@mui/material": "^5.15.20",
Expand Down
13 changes: 13 additions & 0 deletions site/src/App.jsx
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,9 @@ function App() {
localStorage.setItem("tour", event.target.checked);
setTour(!tour);
};

const [visibleTypes, setVisibleTypes] = useState([]);


useEffect(() => {
keepTheme(setModeName);
Expand All @@ -45,20 +48,28 @@ function App() {
setOpen={setOpen}
mode={modeName}
setNavigatorOpen={setNavigatorOpen}
setMode={setModeName}
zoom={zoom}
setZoom={setZoom}
visibleTypes={visibleTypes}
/>
<Tour
run={run}
modeName={modeName}
setFeatures={setFeatures}
setNavigatorOpen={setNavigatorOpen}
themeRef={themeRef}
setZoom={setZoom}
visibleTypes={visibleTypes}
setVisibleTypes={setVisibleTypes}
/>
<MapProvider>
<Header
mode={modeName}
setMode={setModeName}
zoom={zoom}
setZoom={setZoom}
visibleTypes={visibleTypes}
/>
<Map
mode={modeName}
Expand All @@ -70,6 +81,8 @@ function App() {
themeRef={themeRef}
setActiveFeature={setActiveFeature}
activeFeature={activeFeature}
visibleTypes={visibleTypes}
setVisibleTypes={setVisibleTypes}
/>
</MapProvider>
</ThemeProvider>
Expand Down
292 changes: 54 additions & 238 deletions site/src/DownloadCatalog.js

Large diffs are not rendered by default.

3 changes: 2 additions & 1 deletion site/src/Map.jsx
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,8 @@ export default function Map({
navigatorOpen,
setNavigatorOpen,
themeRef,
visibleTypes,
setVisibleTypes,
}) {
const mapRef = useRef();

Expand All @@ -69,7 +71,6 @@ export default function Map({
"buildings",
"transportation",
]);
const [visibleTypes, setVisibleTypes] = useState([]);
const [interactiveLayerIds, setInteractiveLayerIds] = useState([]);

const [lastClickedCoords, setLastClickedCoords] = useState();
Expand Down
Loading

0 comments on commit 4fbdbf8

Please sign in to comment.