Skip to content

Commit

Permalink
feat(parquet/cmd/parquet_reader): Add command to dump the column and …
Browse files Browse the repository at this point in the history
…offset indices (#281)

### Rationale for this change
Makes it easier to visualize the Column and Offset indices that may
exist in a parquet file.

### What changes are included in this PR?
A new command `column-index` added to the `parquet-reader` CLI which
dumps the column and offset indices to the terminal.

The format of the output is based on the parquet-java CLI

---------

Co-authored-by: David Li <li.davidm96@gmail.com>
  • Loading branch information
zeroshade and lidavidm authored Feb 17, 2025
1 parent 413bd36 commit 1643525
Show file tree
Hide file tree
Showing 7 changed files with 260 additions and 10 deletions.
18 changes: 9 additions & 9 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -40,19 +40,19 @@ jobs:
include:
- arch-label: AMD64
arch: amd64
go: 1.22
go: 1.23
runs-on: ubuntu-latest
- arch-label: AMD64
arch: amd64
go: 1.23
go: 1.24
runs-on: ubuntu-latest
- arch-label: ARM64
arch: arm64v8
go: 1.22
go: 1.23
runs-on: ubuntu-24.04-arm
- arch-label: ARM64
arch: arm64v8
go: 1.23
go: 1.24
runs-on: ubuntu-24.04-arm
env:
ARCH: ${{ matrix.arch }}
Expand Down Expand Up @@ -88,8 +88,8 @@ jobs:
fail-fast: false
matrix:
go:
- '1.22'
- '1.23'
- '1.24'
env:
GO: ${{ matrix.go }}
steps:
Expand Down Expand Up @@ -128,8 +128,8 @@ jobs:
fail-fast: false
matrix:
go:
- '1.22'
- '1.23'
- '1.24'
env:
GO: ${{ matrix.go }}
steps:
Expand Down Expand Up @@ -168,8 +168,8 @@ jobs:
fail-fast: false
matrix:
go:
- '1.22'
- '1.23'
- '1.24'
steps:
- name: Checkout
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
Expand All @@ -195,8 +195,8 @@ jobs:
fail-fast: false
matrix:
go:
- '1.22'
- '1.23'
- '1.24'
env:
ARROW_GO_TESTCGO: "1"
steps:
Expand Down Expand Up @@ -229,8 +229,8 @@ jobs:
fail-fast: false
matrix:
go:
- '1.22'
- '1.23'
- '1.24'
steps:
- name: Checkout
uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683 # v4.2.2
Expand Down
13 changes: 12 additions & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@

module github.com/apache/arrow-go/v18

go 1.22.7
go 1.23

toolchain go1.23.2

Expand All @@ -36,6 +36,7 @@ require (
github.com/minio/asm2plan9s v0.0.0-20200509001527-cdd76441f9d8
github.com/minio/c2goasm v0.0.0-20190812172519-36a3d3bbc4f3
github.com/pierrec/lz4/v4 v4.1.22
github.com/pterm/pterm v0.12.80
github.com/stoewer/go-strcase v1.3.0
github.com/stretchr/testify v1.10.0
github.com/substrait-io/substrait-go/v3 v3.6.0
Expand All @@ -53,32 +54,42 @@ require (
)

require (
atomicgo.dev/cursor v0.2.0 // indirect
atomicgo.dev/keyboard v0.2.9 // indirect
atomicgo.dev/schedule v0.1.0 // indirect
cloud.google.com/go v0.118.0 // indirect
github.com/antlr4-go/antlr/v4 v4.13.1 // indirect
github.com/cockroachdb/apd/v3 v3.2.1 // indirect
github.com/containerd/console v1.0.3 // indirect
github.com/creasty/defaults v1.8.0 // indirect
github.com/davecgh/go-spew v1.1.1 // indirect
github.com/dustin/go-humanize v1.0.1 // indirect
github.com/fatih/color v1.15.0 // indirect
github.com/goccy/go-yaml v1.11.0 // indirect
github.com/gookit/color v1.5.4 // indirect
github.com/hashicorp/golang-lru/v2 v2.0.7 // indirect
github.com/json-iterator/go v1.1.12 // indirect
github.com/kr/text v0.2.0 // indirect
github.com/lithammer/fuzzysearch v1.1.8 // indirect
github.com/mattn/go-colorable v0.1.13 // indirect
github.com/mattn/go-isatty v0.0.20 // indirect
github.com/mattn/go-runewidth v0.0.16 // indirect
github.com/mitchellh/mapstructure v1.5.0 // indirect
github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd // indirect
github.com/modern-go/reflect2 v1.0.2 // indirect
github.com/ncruces/go-strftime v0.1.9 // indirect
github.com/pmezard/go-difflib v1.0.0 // indirect
github.com/remyoudompheng/bigfft v0.0.0-20230129092748-24d4a6f8daec // indirect
github.com/rivo/uniseg v0.4.4 // indirect
github.com/stretchr/objx v0.5.2 // indirect
github.com/substrait-io/substrait v0.66.1-0.20250205013839-a30b3e2d7ec6 // indirect
github.com/tidwall/gjson v1.14.2 // indirect
github.com/tidwall/match v1.1.1 // indirect
github.com/tidwall/pretty v1.2.0 // indirect
github.com/xo/terminfo v0.0.0-20220910002029-abceb7e1c41e // indirect
golang.org/x/mod v0.23.0 // indirect
golang.org/x/net v0.35.0 // indirect
golang.org/x/term v0.29.0 // indirect
golang.org/x/text v0.22.0 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20241209162323-e6fa225c2576 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
Expand Down
Loading

0 comments on commit 1643525

Please sign in to comment.