Platform

1. Offering better user experience for:
1. Homepage
2. Data Center
3. Data as API
2. Data as API: Support of external and internal authentication.
3. Admin module Introducing the Secret Management to improve security.
4. Providing the Version control functionality for:
1. Data Sets
2. Data Stores
3. Data as API
4. Dashboards

Please Note: The BDB Platform is compliant with the OWASP security standards.

Data Pipeline

1. Test Suit for Pipeline Before deploying the pipeline, teams can record, build and execute the test case.
2. DS Lab Model Runner New component that helps in ML Ops, where you can deploy and run Models/Scripts created from DS Lab Module.
3. Pipeline Monitoring:
1. The Data metric Tab allows you to analyze the data processing done in the pipeline.
2. Memory Usage by components with min & max thresholds.
4. Enhanced the logs management
1. Option to see the execution container logs in addition to the normal process logs.
2. Time-based filtering of the logs.
5. Event Preview enhancements:
1. Event meta info which can display offset details.
2. The preview section has been enhanced so that the latest records can be displayed.
3. Ability to handle JSON & CSV.
6. Scripting component enhancement:
1. Check-in/Check-out for version management.
2. Script validation to avoid execution errors.
3. Using DS Lab script runner, you can even execute unit test cases before deploying them in the pipeline.
4. Directly consume platform datasets inside the script runner, this allows to provide better data support and enrichment features.
7. DB Sync Enabling direct write to DB, helps in reducing the usage of additional compute resources [Beta feature].
8. The following New Components have been added:
1. Kafka Consumer
2. Rabbit MQ Consumer
3. Rabbit MQ Producer
4. Lookup and Enrich
5. Mongo Change Stream
6. Sandbox Writer
7. Mongo Aggregation
9. Failure Analysis feature where users can analyze failed records produced by components inside the Pipeline. An extensive filter panel has been provided to do the analysis.
10. Enhancing the Copy & Paste feature for retaining the resource configuration.
11. The Play & Pause feature helps users to stop/ start components of the pipeline independently. This helps in reconfiguration without stopping the entire pipeline.
12. UX enhancement
1. Component panel
2. Event information panel
13. Notifications feature to inform remote updation of the pipeline.
14. Component status indicator: Providing Red and Green borders to the Pipeline Components to indicate the component status [active/inactive].
15. Version control functionality: Enable check-in and check-out of pipeline metadata.
16. Optimization of internal services for better speed and agility.

Data Science Lab

1. Notebook
1. Offering the Upload Notebook functionality.
2. Introducing the Save & Download functionality for the Artifacts (.csv, .txt, .json, and .png).
3. Offering the Find & Replace functionality.
4. Providing an option to add the description for a Notebook.
2. Offering the functionality to train and save models inside the DS Lab Notebooks.
3. DS Lab models can now be registered to Data Pipeline (the supported model types are Sklearn, Keras, and Pytorch).
4. DS Lab models can now be registered as an API (the supported model types are Sklearn, Keras, and Pytorch).
5. Data Set: Providing filters for Data sets.
6. Offering the ability to export the Data Science code to the Data Pipeline module (in form of the Python scripts).
7. Implementing Utility Scripts inside the DS Lab module to be imported inside the Notebooks.
8. Providing the ability to define Model type inside the Saved Model function.
9. Introducing the Version control functionality for Projects and Notebooks.
10. Offering the ability to Share Projects & Notebooks with other users/roles.
11. Introducing the GPU support to enhance the DS Lab performance.
12. Presenting the Algorithms supported by the Boilerplate codes for the Regression and Classification algorithms within Notebooks.
13. Enabling the Data profiling options for datasets.
14. Providing an option to save and load Data pre-processing or Transformation objects as pickle files publish later to the Data Pipeline module.
15. Secret Management Encrypting the database-related sensitive/confidential information from getting exposed.

Please Note: The Data Science Lab is a GA release.

Designer

1. Leaflet component- Providing a radius circle instead of the pin on the map.
2. Offering the ability to add dynamic text to the chart above the slider.
3. Offering the adaptive Y-axis scale for charts.
1. The Y-axis should display the nearest to the maximum value in the chart.
4. Presenting percentage values in the Pie chart (Actual and round-off).
5. The tooltip gets positioned with the screen border for all the charts.
6. Offering SDK method to export the filter conditions in Excel.
7. Notifying the user with the proper message while using the designer services when the session gets expired.
8. Introducing the Version Control functionality for Dashboards.
9. Introducing the Filter chip component.
10. Scatter Plot: Providing option to Drag & Zoom/ Reset
11. Drill Highlighter Drill from one component can highlight the other component's data that contains the same data category/field.
12. Offering the ability to Share the Dashboards & Workspaces with other users/roles.
13. Offering better user experience for:
1. Landing Page
2. Manage workspace window
3. Component Container
4. Default Styling for all the components
5. Component Property Palette
6. Object Browser window Palette
7. Dashboard canvas property icons
8. Share Icon

Please Note: The Filter Chip component is a Beta release.

Story

1. Introducing the Dissolution Tree chart as a visualization component.
2. Providing an option to personalize the Data Store with TTL (Time to Live) for optimizing the unnecessary data storage issues.
3. Providing Nested Object support for dimensions and measures.
4. Introduced Insights with the ability to add inference messages to widgets/charts. The charts that support the Insights are:
1. Mixed Chart
2. Area
3. Bar
4. Bubble
5. Column Stack
6. Line
7. Pie chart
8. Scattered Plot
9. Treemap
10. Circumplex
11. Pareto
12. Map chart