Search Results for "data transformation"
Sort By:
Showing 82 open source projects for "data transformation"
View related business solutions-
Inventory and Order Management Software for Multichannel SellersWe are the most powerful inventory and order management platform for Amazon, Walmart, and multichannel product sellers. Centralize orders, product information, and fulfillment operations to run more efficiently, sell more products, and stay compliant with marketplace requirements so you can grow profitably.
-
Agentic AI SRE built for Engineering and DevOps teams.NeuBird AI's agentic AI SRE delivers autonomous incident resolution, helping team cut MTTR up to 90% and reclaim engineering hours lost to troubleshooting.
-
1
The Data Engineering Handbook
Links to everything you'd ever want to learn about data engineering
...It includes beginner and intermediate boot camps, interview guides, data cleaning and transformation resources, and curated lists of newsletters and industry communities, making it useful both for self-study and technical interview preparation. The repository is actively maintained and widely starred, reflecting its role as a go-to reference for newcomers and experienced practitioners alike. -
2
Kapacitor
Open source framework for processing, monitoring, and alerting
Open source framework for processing, monitoring, and alerting on time series data. Kapacitor is a real-time data processing engine for monitoring and alerting, specifically designed to work with time-series data from InfluxDB. -
3
Blue Whale Configuration Platform
Blue Whale smart cloud configuration platform
Has accumulated experience in supporting hundreds of Tencent businesses, compatible with various complex system architectures, born in operation and maintenance, and proficient in operation and maintenance. From configuration management to job execution, task scheduling and monitoring self-healing, and then through operation and maintenance big data analysis to assist operational decision-making, it covers the full-cycle assurance management of business operations in a comprehensive manner. The open PaaS has a powerful development framework and scheduling engine, as well as a complete operation and maintenance development training system, which helps the rapid transformation and upgrading of operation and maintenance. ... -
4
Symfony Serializer
Handles serializing and deserializing data structures
Symfony Serializer is a PHP component that converts objects into various formats (like JSON, XML, or YAML) and vice versa. It handles data normalization and denormalization, making it ideal for APIs and data transformation tasks. The serializer supports complex object graphs and custom normalization logic, allowing developers to convert data in a structured and efficient manner. -
The AI-powered unified PSA-RMM platform for modern MSPs.SuperOps.ai is the only PSA-RMM platform powered by intelligent automation and thoughtfully crafted for the new-age MSP. The platform also helps MSPs manage their projects, clients, and IT documents from a single place.
-
5
kpt
Automate Kubernetes Configuration Editing
...Because they are expected to be used for in-place transformation, the functions need to be idempotent. The package orchestrator enables the magic behind the unique WYSIWYG experience. -
6
Chimney
Scala library for boilerplate-free, type-safe data transformations
Chimney is a Scala library that facilitates boilerplate-free, type-safe data transformations between different data types. It enables developers to define mappings between source and target types, ensuring that transformations are checked at compile time, thereby reducing runtime errors and enhancing code reliability. -
7
Apache Spark
A unified analytics engine for large-scale data processing
Apache Spark is a unified engine for large-scale data processing, offering APIs for batch jobs, streaming, machine learning, and graph computation. It builds on resilient distributed datasets (RDDs) and the newer DataFrame/Dataset abstractions to provide fault-tolerant, in-memory computation across clusters. Spark’s execution engine handles scheduling, shuffles, caching, and data locality so users can focus on transformations rather than infrastructure plumbing. With Spark Streaming... -
8
Hacks
A collection of hacks and one-off scripts
Hacks is a collection of experimental scripts, utilities, and one-off tools created to solve specific problems in security research, data processing, and automation. Rather than being a single cohesive application, it serves as a repository of practical command-line tools that can be used independently or combined into workflows. The scripts cover a wide range of tasks, including URL manipulation, parameter replacement, data extraction, and reconnaissance automation. Many of the tools in the... -
9
Monocle
Optics library for Scala
Monocle is a pure functional, optics library for Scala providing immutable data access and transformation tools — including Lens, Prism, Iso, Optional, and Traversal. It enables composable, declarative modifications of deeply nested immutable structures in a concise and type-safe fashion. -
Outbound sales softwareAdversus is an outbound dialing solution that helps you streamline your call strategies, automate manual processes, and provide valuable insights to improve your outbound workflows and efficiency.
-
10
LoopVectorization.jl
Macro(s) for vectorizing loops
LoopVectorization.jl is a Julia package for accelerating numerical loops by automatically applying SIMD (Single Instruction, Multiple Data) vectorization and other low-level optimizations. It analyzes loops and generates highly efficient code that leverages CPU vector instructions, making it ideal for performance-critical computing in fields such as scientific computing, signal processing, and machine learning. -
11
Flix
The Flix Programming Language
Flix is a statically typed programming language combining functional, imperative, and logic paradigms, with first‑class Datalog constraints and a polymorphic effect system. Designed to run on the JVM, Flix enforces purity tracking at compile time, supports algebraic data types, tail‑call elimination, and allows entire Datalog programs as values. -
12
rxRust
Zero-cost & Type-safe Reactive Extensions for Rust
rxRust is a zero-cost, type-safe implementation of Reactive Extensions for Rust that brings functional reactive programming paradigms into the Rust ecosystem. It enables developers to model asynchronous data streams and event-driven systems declaratively, using composable operators that transform and combine streams over time. The library is designed to leverage Rust’s ownership and type systems to ensure memory safety and efficient resource management without sacrificing performance. It... -
13
PHP Map
PHP arrays and collections made easy
Aimeos/Map is a lightweight PHP collection utility that makes working with arrays and array-like data much easier and more expressive by offering a fluent, object-oriented interface inspired by jQuery and Laravel collections. It wraps standard PHP arrays in a “Map” object, letting developers chain powerful methods for creating, transforming, filtering, sorting, and aggregating data without verbose boilerplate code. This approach improves readability and maintainability when dealing with... -
14
Prompt Engineering Interactive Tutorial
Anthropic's Interactive Prompt Engineering Tutorial
Prompt-eng-interactive-tutorial is a comprehensive, hands-on tutorial that teaches the craft of prompt engineering with Claude through guided, executable lessons. It starts with the anatomy of a good prompt and moves into techniques that deliver the “80/20” gains—separating instructions from data, specifying schemas, and setting evaluation criteria. The course leans heavily on realistic failure modes (ambiguity, hallucination, brittle instructions) and shows how to iteratively debug prompts the way you would debug code. Lessons include building prompts from scratch for common tasks like extraction, classification, transformation, and step-by-step reasoning, with checkpoints that let you compare your outputs against solid baselines. ... -
15
Chartkick
Create beautiful JavaScript charts with one line of Ruby
...Because of its integration with ActiveRecord, developers can quickly visualize trends in their application’s data with minimal transformation. Chartkick is especially valued in dashboards, reporting tools, and admin panels where quick, maintainable visualization is needed without heavy front-end development. -
16
ioredis
A performance-focused Redis client for Node.js
...It supports Cluster, Sentinel, Streams, Pipelining and of course Lua scripting & Pub/Sub (with the support of binary messages). High performance. Delightful API. It works with Node callbacks and Native promises. Transformation of command arguments and replies. Transparent key prefixing. Abstraction for Lua scripting, allowing you to define custom commands. Support for binary data. Support for TLS. Support for offline queue and ready checking. Support for ES6 types, such as Map and Set. Support for GEO commands. Support for Redis ACL. Sophisticated error handling strategy. ... -
17
Kornia
Open Source Differentiable Computer Vision Library
Kornia is a differentiable computer vision library for PyTorch. It consists of a set of routines and differentiable modules to solve generic computer vision problems. At its core, the package uses PyTorch as its main backend both for efficiency and to take advantage of the reverse-mode auto-differentiation to define and compute the gradient of complex functions. Inspired by existing packages, this library is composed by a subset of packages containing operators that can be inserted within... -
18
bidji
data transformation and code generation
Bidji project is a set of tools for: - data transformation - code generation (which uses data transformation) -
19
VulcanSQL
Data API Framework for AI Agents and Data Apps
Vulcan SQL is a modern data API framework that lets you build secure and scalable data APIs directly from SQL files. Designed for data teams, it allows the definition of parameterized queries, policy enforcement, and transformation layers using familiar SQL syntax. Vulcan SQL integrates with BI tools and data warehouses, making it easy to expose internal datasets as RESTful APIs. -
20
lcd-image-converter
Tool to create bitmaps and fonts for embedded applications.
This program allows you to create bitmaps and fonts, and transform them to "C" source format for embedded applications. The transformation of the images to the source code is made by using templates. Therefore, by modifying the templates, you can change the format of the output within certain limits. -
21
LinAsm
Collection of fast and optimized assembly libraries for x86-64 Linux
...It implements many common and widely used algorithms for array manipulations: searching, sorting, arithmetic and vector operations, unit conversions; fast mathematical and statistic functions; numbers and time converting algorithms; finite impulse response (FIR) digital filters; spectrum analysis algorithms, Fast Hartley transformation; CPU cache friendly functions and extremely fast abstract data types (ADT) such as hash tables b-trees, and much more. LinAsm libraries are written on FASM assembly language. They are stable and have appropriate benchmarks for many units. All libraries are well documented and grouped by their functionality. To get more information about this library, please visit the official web site: http://linasm.sourceforge.net -
22
towhee
Framework that is dedicated to making neural data processing
Towhee is an open-source machine-learning pipeline that helps you encode your unstructured data into embeddings. You can use our Python API to build a prototype of your pipeline and use Towhee to automatically optimize it for production-ready environments. From images to text to 3D molecular structures, Towhee supports data transformation for nearly 20 different unstructured data modalities. We provide end-to-end pipeline optimizations, covering everything from data decoding/encoding, to model inference, making your pipeline execution 10x faster. ... -
23
XForms to XHTML+Javascript (AJAX) conversion based on a unique XSL transformation. Suitable server-side (PHP) or client-side (Internet Explorer, Mozilla FireFox, Opera, Safari) browser treatement where an XSLT 1.0 engine is available
-
24
Specter
Clojure(Script)'s missing piece
Specter is a powerful Clojure (and ClojureScript) library that revolutionizes navigation and manipulation of deeply nested and recursive data structures through a flexible, high-performance API beyond what vanilla Clojure offers. Specter has an extremely simple core, just a single abstraction called "navigator". Queries and transforms are done by composing navigators into a "path" precisely targeting what you want to retrieve or change. Navigators can be composed with any other navigators,... -
25
MS-Helios
MS-Helios: A Circos wrapper to visualize multi-omic datasets
Advances in high-resolution mass spectrometry facilitate the identification of hundreds of metabolites, thousands of proteins and their post-translational modifications. This remarkable progress poses a challenge to data analysis and visualization, requiring methods to reduce dimensionality and represent the data in a compact way. To provide a more holistic view, we recently introduced circular proteome maps (CPMs). However, the CPM construction requires prior data transformation and extensive knowledge of the Perl-based tool, Circos. We present MS-Helios, an easy to use command line tool with multiple built-in data processing functions, allowing non-expert users to construct CPMs or in general terms circular plots with a non-genomic basis. ...
