Aporia Documentation
Get StartedBook a Demo🚀 Cool StuffBlog
V2
V2
  • 📖Aporia Docs
  • 🤗Introduction
    • Quickstart
    • Support
  • 💡Core Concepts
    • Why Monitor ML Models?
    • Understanding Data Drift
    • Analyzing Performance
    • Tracking Data Segments
    • Models & Versions
  • 🚀Deployment
    • AWS
    • Google Cloud
    • Azure
    • Databricks
    • Offline / On-Prem
    • Platform Architecture
  • 🏠Storing your Predictions
    • Overview
    • Real-time Models (Postgres)
    • Real-time Models (Kafka)
    • Batch Models
    • Kubeflow / KServe
  • 🧠Model Types
    • Regression
    • Binary Classification
    • Multiclass Classification
    • Multi-Label Classification
    • Ranking
  • 🌈Explainability
    • SHAP values
  • 📜NLP
    • Intro to NLP Monitoring
    • Example: Text Classification
    • Example: Token Classification
    • Example: Question Answering
  • 🍪Data Sources
    • Overview
    • Amazon S3
    • Athena
    • BigQuery
    • Databricks
    • Glue Data Catalog
    • Google Cloud Storage
    • PostgreSQL
    • Redshift
    • Snowflake
    • Microsoft SQL Server
    • Oracle
  • ⚡Monitors & Alerts
    • Overview
    • Data Drift
    • Metric Change
    • Missing Values
    • Model Activity
    • Model Staleness
    • Performance Degradation
    • Prediction Drift
    • Value Range
    • Custom Metric
    • New Values
    • Alerts Consolidation
  • 🎨Dashboards
    • Overview
  • 🤖ML Monitoring as Code
    • Getting started
    • Adding new models
    • Data Segments
    • Custom metrics
    • Querying metrics
    • Monitors
    • Dashboards
  • 📡Integrations
    • Slack
    • Webhook
    • Teams
    • Single Sign On (SAML)
    • Cisco
  • 🔐Administration
    • Role Based Access Control (RBAC)
  • 🔑API Reference
    • REST API
    • API Extended Reference
    • Custom Segment Syntax
    • Custom Metric Syntax
    • Code-Based Metrics
    • Metrics Glossary
  • ⏩Release Notes
    • Release Notes 2024
    • Release Notes 2023
Powered by GitBook
On this page
  • October 2023
  • September 2023
  • August 2023
  • July 2023
  • June 2023
  • May 2023
  • April 2023
  • March 2023
  • February 2023
  • January 2023
  1. Release Notes

Release Notes 2023

PreviousRelease Notes 2024

Last updated 8 months ago

Welcome 2023! We are extremely excited for the year ahead as we continuously enhance our platform to ensure that you and your team can observe your models in production, detect issues and improve their performance as efficiently as possible.

In this page, you'll be able to find a constantly-growing list of some of our most impactful new features and enhancements that we release every month.

October 2023

  • Deactivate versions - There is a time when a version gets old and we want to be able to observe it but stop syncing new data. For this scenarios, we are happy to introduce the ability to deactivate an existing version. Don't worry, you can always turn it active again.

  • Multiple integrations of the same type - Different teams use differnt slack channels for notifications or want to create different webhook automation once an alert is fired. For this reason, we now support creation of multiple integrations of the same type for all of our available integrations.

  • "My Workspaces" view - You can now enjoy our new pinned view where you can observe all models, monitors, alerts and investigation cases, across all their respective workspaces in a single view.

  • Global filters for dashboards - Sometimes we want to be able to view the same insights for different segments of our data without needing to rebuild our dashboard. For those cases, you can now mark specific segment groups for global filtering. Once marked as such, you will be able to use those segments as global filters in dashboards.

September 2023

  • New version actions - Deletion of versions / datasets is now supported via both UI & REST API.

  • Resolve multiple alerts - You can now resolve multiple alerts in one click. Just filter the alerts you wish to dispose and click “Resolve All”!

August 2023

  • Bug fixes & performance improvements!

July 2023

  • New dashboard widgets - Visualizations are a powerful tool for analyzing your model performance, business impact, data behavior, etc. For this reason we are happy to introduce three new widgets

  • API keys - Account admins can now simply manage their API keys by going to Account Management > API Keys.

  • SQL for blob storage - You can now transform data originated in S3/ AzureBlobStorage/ GoogleCloudStorage using a SQL query.

June 2023

  • Extended error information - You will be able to see a full traceback for errors detected while trying to retrieve your datasets/metrics.

  • Default investigation case - Depending on your monitor type, a default investigation case will automatically be created to provide you the most relevant tools and tips to quickly get to the root cause of the issue detected. Default investigation cases are now available for prediction drift, data drift and performance degradation monitors.

May 2023

  • New integrations - We've expanded our integration support and now you can receive alert notifications via your organization Teams & Webhook.

  • New data source action - Deleting a data source is available by clicking on the actions button in the data connectors page

  • Filters in custom metrics - In order to build your custom metric you may need to apply different data filtering in different parts of the calculation. For those cases, Aporia supports custom filtering in custom metrics. For more information and examples read our docs.

  • Value range monitor - You can now create value range monitor to get alerted when your inference data exceeds the desired range.

  • Dashboard widgets - You can now control the granularity with which to plot your time series widgets.

April 2023

  • Multiple dashboards per model - Different users might like to get different insights on the same model. For this reason, we added support for creating multiple dashboards per model.

  • Error detection for datasets - You will be able to see an indication in the relevant places across the platform in case we detected any error while trying to retrieve your datasets.

  • Performance improvements - Resolved various performance bottlenecks and dramatically increased performance at scale.

  • Edit versions - You can now edit existing stages by clicking on "edit" in the model versions page

March 2023

  • Default dashboard - Depending on your model type, a default dashboard will automatically be created to provide you a quick overview and insights on your first integrated version.

  • Bug fixes - Resolved errors raised by using special characters in version schema.

  • New custom metrics actions - Deleting a custom metric is available by clicking on the actions button in the custom metrics page

  • Cross-version monitoring - We added the ability to use "all versions" in the monitors configurations. This way you can create monitors to detect issues across the unification of all model versions.

February 2023

  • Azure AD authentication for Postgres data source - In addition to using username & password, you can now configure your Postgres data source to use Azure AD authentication. This is available for accounts using SSO integration with Azure AD.

  • New model actions - You can now rename and delete your models. Just click on the actions button in the models management page

  • Ranking metrics support - Accuracy@k, MRR@k and nDCG@k are natively supported in Aporia platform and you can use them in monitors, widgets, custom metrics, etc.

  • Databricks deployment over Azure - Aporia deployment over Databricks is now supported for clients using Azure as their cloud provider.

  • Bug fixes & performance improvements!

January 2023

Direct Data Connectors - we are happy to introduce you with our transformative technology that empowers ML teams to effortlessly monitor and track their ML models by seamlessly integrating Aporia with their production database. By directly accessing your existing data lake, you can effortlessly monitor billions of predictions at minimal cloud costs (never duplicate your data!).

Code based metrics - This new advanced feature allows users to allow define Pyspark-based metrics that allow for computation on raw data, element-wise operations, and support third-party libraries. For usage example explore our .

Extended REST API support - Create and delete data sources is now supported via REST API. For more details read our .

New DDC - For those of you who store your data in , you can now directly and easily integrate it using our new data connectors.

Recalculate metrics API - sync your data on demand without waiting for the upcoming scheduled calculation job. We've added via API.

Extended REST API support - Edit segments is now supported via REST API. Whether it's part of your CI/CD pipeline, triggered by a new value monitor alert, or just to ease building your Dashboards. For more details read our .

Drift monitors - Different users might like to monitor drift using different metric to fit they use-case best. For this reason, we added support for choosing the monitored drift metric. Available metrics can be found .

Metrics on actuals - All our statistical metrics can now be used on actual fields as well. You can easily monitor & visualize them all across the platform. More information about our available metrics can be found .

Cross model dashboards - Sometimes we need to get insights on multiple models in one place. It could be observe model orchestration or just to get an overall status in one glance. For this reason, we added support for creating .

Alert consolidation - Monitors can create unnecessary noise when thresholds are not yet fine-tuned or your team is handling an ongoing issue. Learn how to keep notifications meaningful by .

Workspaces - For enterprises and organizations which require silos for separate teams/models/data integrations... Aporia introduces workspaces (team silos) managed by Aporia account admins. For more information read our .

Role Based Access Control - Full is now available in Aporia! Using account-level and workspace-level permissions, users will only have access to the data and actions for which they are permitted.

Custom segments - Grouping segments with common logic is now available when creating / editing custom segments. Learn how to use it with our updated .

New DDCs - For those of you who store your data in / Azure Blob Storage, you can now directly and easily integrate it using our new data connectors.

REST API - For those of you who would like to create automations for model integration, monitors creation, schema validation, etc. For more information read the .

Snowflake data source - For those of you who store your data in snowflake, you can now directly and easily integrate it using our new

Custom segments - You can now create custom segments using a SQL-based syntax, that empowers you to create that exact segment you wish. For more info, check out our .

For more details read the full .

⏩
Code-based metrics guide
REST API docs
Microsoft SQL Server
recalculating metrics on demand
REST API docs
here
here
cross model dashboards
consolidating your alerts within Aporia
RBAC docs
role based access control
Custom Segment Syntax examples
BigQuery
REST API documentation
snowflake data connector.
docs
announcement post
🎉
Metric correlation & Metric by segment
Histogram over time
Delete existing data connector
Edit Training / Serving