Skip to content

fix: data service changelog #303

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
224 changes: 224 additions & 0 deletions changelog/data-service.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,224 @@
---
title: "Data Service"
sidebarTitle: "Data Service [1.1.10]"
---

<Update label="1.1.10" description="2025-04-21">
## v1.1.10
---

### S3 Upload Improvements
- Added support for passing encryption headers while uploading stream data to S3.
- Added support for both file path and direct value from environment variables for secrets like redis connection.

### Batch and Fine-tune Enhancements
- Added provider_options as a key for batches and fine-tunes.

### Stream Handling
- Improved stream cleanup for validation processes.
</Update>

<Update label="1.1.9" description="2025-04-10">
## v1.1.9
---

### File Handling Fixes
- Fixed issue with extra bytes being added to files during processing.
</Update>

<Update label="1.1.8" description="2025-04-04">
## v1.1.8
---

### File Upload Improvements
- Updated socket timeout for long requests during file uploads to prevent timeouts.
</Update>

<Update label="1.1.7" description="2025-03-28">
## v1.1.7
---

### Fireworks Fine-tuning Support
- Added support for Fireworks fine-tuning operations using Version2.

### Batch Processing Improvements
- Included response tokens calculation in provider batch output.
- Fixed file loading in memory issues for better performance.
</Update>

<Update label="1.1.6" description="2025-03-25">
## v1.1.6
---

### S3 SDK Updates
- Upgraded S3 SDK to latest version for fixing issue with S3 streaming.
</Update>

<Update label="1.1.5" description="2025-03-21">
## v1.1.5
---

### Batch Processing Enhancements
- Improved provider batch output handling.
- Added support for custom batch output paths.
- Increased maximum lines to 500k and chunk size to 5MB for better performance.
</Update>

<Update label="1.1.4" description="2025-03-20">
## v1.1.4
---

### Vertex Embeddings Batches Support
- Added support for Vertex batch embeddings.

### S3 and Storage Improvements
- Added support for custom S3 get operations.
- Back-merged Clickhouse query changes for better performance.

### Batch Processing Updates
- Included model information in log objects.
- Implemented custom batch processing output generations.

### HTTPS Support
- Added HTTPS connection support for secure communications.

</Update>

<Update label="1.1.3" description="2025-03-07">
## v1.1.3
---

### Infrastructure Updates
- Streamlined uploaded file location for Bedrock operations.
</Update>

<Update label="1.1.2" description="2025-02-27">
## v1.1.2
---

### Vertex Integration
- Added support for Vertex provider options for batches.

### Infrastructure Updates
- Fixed missing custom S3 support for file retrieval.
- Implemented cluster mode Redis for queues.
- Updated fine-tune status handling.
</Update>

<Update label="1.1.1" description="2025-02-20">
## v1.1.1
---

### S3 Enhancements
- Made S3 bucket optional for Bedrock batches.
- Added S3 encryption header support for finetunes and batches.
- Implemented SSE file upload support.

### Logging Improvements
- Added filtering for log exports.
- Implemented end limit for log export records.

### Performance Optimizations
- Added optional push gateway support.
- Implemented internal memory cache for better performance.
</Update>

<Update label="1.1.0" description="2025-02-10">
## v1.1.0
---

### Bull Board Integration
- Added Bull Board for visualizing job queues and their status.

### Batch Job Retry Support
- Implemented retry functionality for batch jobs to handle failures gracefully.

### Prometheus Metrics Enhancements
- Added Prometheus metrics for batch jobs and fine-tuning operations.

### Error Handling Improvements
- Enhanced error handling across the service.

</Update>

<Update label="1.0.8" description="2025-02-04">
## v1.0.8
---

### Azure Fine-tuning Support
- Added support for Azure fine-tuning operations.

</Update>

<Update label="1.0.7" description="2025-01-13">
## v1.0.7
---

### Fine-tune v2 Implementation
- Implemented version 2 of the fine-tuning functionality.
</Update>

<Update label="1.0.6" description="2024-01-08">
## v1.0.6
---

### Prompt Slug Filter
- Added support for data exports filtering by PromptSlug.

</Update>

<Update label="1.0.5" description="2024-01-06">
## v1.0.5
---

### Batch Exports
- Added support for batch exports functionality.
</Update>

<Update label="1.0.4" description="2023-12-17">
## v1.0.4
---

### Code Quality Improvements
- Fixed dynamic port retrieval from environment variables.
</Update>

<Update label="1.0.3" description="2023-11-28">
## v1.0.3
---

### Vision Fine-tuning Support
- Added support for vision fine-tuning validation for OpenAI.
- Implemented S3 bucket support for fine-tunes.

### AWS Integration Improvements
- Fixed assumed role handling for Bedrock fine-tuning dataset URLs.
- Improved S3 bucket path handling for Bedrock fine-tune operations.
- Achieved parity with Enterprise Gateway for data sources.
</Update>

<Update label="1.0.2" description="2023-11-20">
## v1.0.2
---

### Fine-tuning Enhancements
- Added support for OpenAI job start and Fireworks upload.
- Improved handling of chunk type failures with JSON.
</Update>

<Update label="1.0.1" description="2023-10-25">
## v1.0.1
---

### Fireworks Fine-tuning Support
- Added support for Fireworks fine-tuning operations.

</Update>

<Update label="1.0.0" description="2023-10-04">
## v1.0.0
---

### Initial Release
- Base version of the Data Service with core functionality.
</Update>
2 changes: 1 addition & 1 deletion docs.json
Original file line number Diff line number Diff line change
Expand Up @@ -831,7 +831,7 @@
},
{
"group": "Enterprise Releases",
"pages": ["changelog/enterprise", "changelog/helm-chart"]
"pages": ["changelog/enterprise", "changelog/helm-chart", "changelog/data-service"]
},
{
"group": "Product Releases",
Expand Down