Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get a spark cluster running in docker compose #1

Merged
merged 3 commits into from
May 9, 2024
Merged

Conversation

MrCreosote
Copy link
Member

~/spark/spark-3.5.1-bin-hadoop3-scala2.13$ ./bin/run-example --master spark://0.0.0.0:7077 SparkPi 10 2> /dev/null
Pi is roughly 3.1426071426071425

Identical to kbaseincubator/cdm-prototype-spark#1

MrCreosote added 3 commits May 3, 2024 10:34
Python programs don't work yet

```
~/spark/spark-3.5.1-bin-hadoop3-scala2.13$ ./bin/run-example --master
spark://0.0.0.0:7077 SparkPi 10 2> /dev/null
Pi is roughly 3.1426071426071425
```
@MrCreosote MrCreosote requested a review from Tianhao-Gu May 8, 2024 23:23
@github-advanced-security
Copy link

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.

Copy link
Collaborator

@Tianhao-Gu Tianhao-Gu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@MrCreosote MrCreosote merged commit 6f36d45 into main May 9, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants