Neosync - An open-source synthetic data platform for anonymizing PII, generating synthetic data, and synchronizing environments.
## Overview of Neosync
Neosync is an open-source synthetic data platform that enables developers to anonymize personally identifiable information (PII), generate synthetic data, and synchronize environments. It is designed to enhance testing, debugging, and development workflows while ensuring compliance with data protection regulations such as GDPR and HIPAA.
## Core Features of Neosync
Neosync offers the following core features:
- **Synthetic Data Generation**: Creates synthetic data based on database schemas.
- **Data Anonymization**: Protects sensitive information in production data.
- **SQL Query Support**: Allows subsetting production databases for local and CI testing.
- **Asynchronous Pipelines**: Supports job retries, failure handling, and event-sourced replay.
- **Referential Integrity**: Automatically maintains data relationships.
- **GitOps Integration**: Uses declarative configurations for CI pipelines.
- **Pre-built Transformers**: Includes converters for major data types.
- **Custom Transformers**: Enables creation of custom transformers using JavaScript or LLMs.
- **Database Integrations**: Works with Postgres, MySQL, S3, and other popular systems.
## Neosync and Data Compliance
Neosync helps organizations comply with regulations like GDPR, HIPAA, and DPDP by:
- Anonymizing sensitive production data to remove PII.
- Generating synthetic data to reduce reliance on real user data.
- Providing tools to subset and synchronize data securely across environments.
## Industries Using Neosync
Neosync is particularly useful in industries requiring high-quality synthetic data or strict data privacy, including:
- **Autonomous Vehicles**: Simulating edge cases for model training.
- **Finance**: Testing systems without exposing real transaction data.
- **Healthcare**: Protecting patient data while enabling development.
- **Industrial Applications**: Generating synthetic datasets for machine learning.
## Deploying Neosync
Neosync can be deployed via:
- **Docker Compose**: Run `make compose/up` to start (requires Docker). Access the UI at `http://localhost:3000`. Use `make compose/down` to stop.
- **Kubernetes**: Advanced deployment options are detailed in the [Deployment Documentation](https://docs.neosync.dev/deploy/introduction).
## Neosync Resources
Users can access the following resources:
- **Documentation**: [Neosync Docs](https://docs.neosync.dev)
- **Community Support**: [Neosync Discord](https://discord.com/invite/MFAMgnp4HF)
- **GitHub Repository**: [Neosync GitHub](https://github.com/nucleuscloud/neosync)
- **Official Website**: [Neosync Website](https://www.neosync.dev)
### Citation sources:
- [Neosync](https://github.com/nucleuscloud/neosync) - Official URL
Updated: 2025-04-01