SpeedPipe ETL

SpeedPipe ETL is a gem, with online logs, to build data pipelines in a simple and fast way.

Get started

SpeedPipe is a DSL, because of that, it's very simple to do something, just create a new file and call the specific functions.

Install the gem:

gem install speedpipe

Create new file:

require 'speedpipe'

# one ou more source
source do
  [1, 2, 3, 4, 5]
end

transform do |data|
  data.each { |item| item + 1 }
end

destination do |data|
  # save array one file
  array_text = data.join(', ')
  File.open('array_file.txt', 'w') { |file| file.write(array_text) }
end

Documentation

Read more in website speedpipe