SQL Data Catalog

Release notes

1.10.0 - February 22, 2021

Major changes

  • We are proud to be levelling up the Rules and Suggestions features! Starting this release, you are able to use the powerful filter bar you are used to from the Classification page to design your Rules!

1.9.14 - February 9, 2021

Improvements

  • Performance improvements for the Instances and Databases Overview pages!

API changes

  • Retrieving all instances does not accept a category id anymore and will not fetch the classification distribution..
  • Classification distribution can be retrieved from /v1/instances/metadata/{instanceId}.
  • Removed /v2/instances endpoint.

1.9.13 - January 26, 2021

Improvements

  • Moved the save filter button next to the load filter drop down on the Classifications page.
  • Saved filters can now be updated and deleted.

1.9.12 - January 14, 2021

Changes

  • The column name filter will now allow for exact matches of column names when the wildcard character '%' is not
    supplied.

API changes

  • We've removed all patterns endpoints as we are transitioning from individual rule patterns to rule filters.

1.9.11 - December 9, 2020

Major changes

We have added Intercom, allowing you to talk directly to the product team for issues/ideas and concerns you might have while using the product. Look for Intercom in the bottom right corner.

1.9.10 - December 2, 2020

Fixes

  • Fixed Suggestions page intermittent sorting not working.

1.9.9 - November 27, 2020

Improvements

  • Fix the suggestions link on the classifications page after applying classifications.
  • Significantly improved performance of the instance overview page

1.9.8 - November 18, 2020

Improvements

  • Support multiple column filters including SQL Like syntax, e.g. %card%num%.
  • Ability to save the classification filters
  • Drilling down from the overview pages now populates the column filters.

1.9.7 - November 9, 2020

Improvements

  • Introduced database and instance filters on the estate-wide Classification page.

1.9.6 - October 26, 2020

Improvements

  • Improved classification page usability.

1.9.5 - October 20, 2020

Improvements

  • You can now reorder columns on Classification page by hovering over Table View and dragging them in the desired order. The configuration is preserved between sessions.
  • Free text attributes are now displayed on the Classification page. As with all other columns they can be ordered or hidden.

1.9.4 - October 13, 2020

Improvements

  • You can now hide and show columns in the classification view.
  • Usability improvements to the Authorization tokens workflow.

Fixes

  • Fixed a crash when downloading classifications from the estate-wide classification page.

1.9.3 - October 5, 2020

Major changes

  • We've introduced a new Classification tab, which allows you to classify columns across your entire estate.
  • The summary cards are now accessible through the Overview tab.
  • Get-ClassificationColumn PowerShell cmdlet now supports retrieving columns across Instances and Databases!
  • To retrieve all columns classified as Information Classification Confidential across your entire state, simply invoke Get-ClassificationColumn -Tags @{ "Information Classification" = @("Confidential") }
  • To retrieve all columns with tags applied, pass in the flag -WithTagsApplied (-WithNoTags for the inverse)
  • To retrieve all columns in empty tables (for some quick descoping), pass in the flag -InEmptyTables
  • For more information about the supported flags, please see our documentation.

Improvements

  • Classification sidebar header and Apply button are now always visible
  • Usability improvements for adding patterns to rules

Fixes

  • Fix bug where columns become unchecked when classification sidebar is opened

API changes

  • Our GET /columns API now allows column retrieval across your entire estate, instead of being restricted per database. It still supports the database filter parameter (?databaseId=) if you enjoyed the old functionality better.

1.9.2 - September 21, 2020

Improvements

  • Added the ability to sort suggestion rules by table, column, rule, and pattern

1.9.1 - September 17, 2020

Improvements

  • The Instances and Databases pages now allow you to customize your dashboards by category!

1.9.0 - September 3, 2020

Improvements

  • The pie charts in the Web UI now show the proportion of columns that have had any tag applied.
  • Added foundational information types and information classification tags for new installations to ease onboarding!

Changes

  • The Microsoft "Information Type" and "Sensitivity" categories will now be imported as "MS Information Type" and "MS Sensitivity" respectively. These will be read-only.
  • For existing users, the original Microsoft "Information Type" and "Sensitivity" categories are no long special-cased. Existing classifications will remain unchanged, but the tags are now fully editable.

API changes

  • The "sensitivityLabelDistribution" property on instance and database metadata has been replaced with "classificationDistribution", which lists the number of columns that have and have not been classified.

1.8.2 - July 23, 2020

Improvements

  • Added syntax highlighting for code snippets on the API page.

Fixes

  • Fixed a bug where suggestions would be only partially generated.

1.8.1 - July 14, 2020

Improvements

  • Updated API documentation, split 'Databases, tables and columns' into separate sections.

1.8.0 - June 18, 2020

Improvements

  • Improved the help text in the configuration app.
  • The Set-Classification PowerShell cmdlet now has option to update free-text attributes.

Changes

  • URLs for pages listing columns have changed: the database name is replaced with the database ID.

API changes

  • column/{id}/tags and column/{id}/freetextattributes get and put endpoints have been retired in favour of column/{id} get and patch endpoints.

  • The Powershell module and Web frontend have been updated to use the new endpoints; please get in touch with us at if this has broken any of your own code.

  • We have replaced database name in endpoints with database id, and regularised our endpoint structure.

Affected endpoints are:

  • instances/{id}/databases has become databases?instanceId={id}

  • instances/{id}/databases/{databaseName} has become databases/{id}/metadata - a smaller return object with just the instance and database id and name is available on databases/{id}

  • instances/{id}/databases/{databaseName}/tables has become tables?databaseId={databaseId}

  • instances/{id}/databases/{databaseName}/columns has become columns?databaseId={databaseId}

  • instances/{id}/databases/{databaseName}/datatypes has become columns/datatypes?databaseId={databaseId}

  • instances/{id}/databases/{databaseName}/columns/export?format={format} has become columns/export?databaseId={databaseId}&format={format}

  • instances/{id}/columns/export?format={format} has become columns/export?instanceId={instanceId}&format={format}

  • instances/{id}/databases/{databaseName} patch endpoint for archiving has become databases/{databaseId}

  • instances/{id}/databases/{databaseName}/scan post endpoint has become databases/scans?databaseId={databaseId}

  • instances/{id}/databases/{databaseName}/scan/{scanId} get endpoint has become databases/scans?databaseScanId={scanId}

  • You can use the databases?instanceId={id} endpoint to get a list of databases with their ids for use with the new endpoints.

  • instances/{id}/sensitivity-label-distribution and instances/{id}/databases/{databaseName}/sensitivity-label-distribution endpoints have been removed - use databases/{id}/metadata to get this data instead

1.7.14 - May 21, 2020

Improvements

  • We've managed to increase the performance of Get-ClassificationColumn PowerShell cmdlet, used in all automation, between 6 - 13 times, addressing customer issues when trying to classify a substantial number of columns at once!

1.7.13 - May 13, 2020

Fixes

  • Fix for database scan failure, when database objects have extended property with hex values
  • Fix an issue when expanding API category in API page crashes UI

1.7.12 - May 12, 2020

Improvements

  • Increased the maximum table size in the UI to 500.

Fixes

  • Fixed instance scan completed status in instances page

1.7.11 - May 6, 2020

Improvements

  • API calls to /hubs/notifications and /hubs/notifications/negotiate are no longer logged - these are automated, internal SignalR calls and just add noise to logs.
  • Performance of bulk classification has been improved to make it run significantly faster.

1.7.10 - April 27, 2020

Fixes

  • Fixed a bug where it was not possible to set up a non-admin account as the service user.

API changes

  • The Bulk Classification endpoint (api/v1.0/columns/bulk-classification) now accepts an array of ColumnIds instead of the previously more verbose ColumnIdentifiers.
  • PowerShell cmdlets such as Set-Classification have been updated for the above change, so it will work in your scripts as before.
  • The Get Classifications endpoint (api/v1.0/instances/INSTANCE_NAME/databases/DATABASE_NAME/columns), exposed via the Get-ClassificationColumn PowerShell cmdlet, returns the appropriate ColumnIds.

1.7.9 - April 14, 2020

Fixes

  • Fixed a bug in the configuration app where an exception occurred if the given username was not an administrator.

1.7.8 - March 23, 2020

Improvements

  • Added the ability to remove tags using bulk classification

1.7.7 - March 17, 2020

Fixes

  • The Set-Classification PowerShell script now classifies columns in batches, solving the issues that some users experienced when trying to classify a large amount of columns.
  • Classification: Attempting to assign free text attributes to an invalid column (e.g. misspelled database name) now correctly responds with NotFound (404) instead of Ok (200).
  • Databases, tables and columns: Requesting details on a missing database (e.g. due to misspelled database name) now correctly responds with NotFound (404) instead of Ok (200).
  • Fixed a bug where the Credit Cards and National ID suggestion rules could not be modified

1.7.6 - March 9, 2020

Improvements

  • Added Start-ClassificationDatabaseScan to the Powershell module.

Fixes

  • Disable suggestion operations in the UI when suggestions being regenerated.

API changes

  • metadata.status.isReachable (e.g. on api/v1.0/instances/) now returns 'unknown' when no scans have completed on the instance, 'false' when a scan has returned an error, and 'true' when a scan has successfully completed.

1.7.5 - March 5, 2020

Improvements

  • Allow users to configure their own suggestion rules

1.7.4 - February 24, 2020

Improvements

  • Stopped bulk classification from overwriting tags on all categories

API changes

  • API now returns Bad Request or Not Found rather than Internal Server Error when given an invalid free-text attribute, database or instance id in some cases.

1.7.3 - February 12, 2020

Improvements

  • Reduced the number of banners on the column classification page.

Fixes

  • Fix CSS bug on taxonomy page for macOS Safari

1.7.2 - February 4, 2020

Major changes

  • If HTTPS is configured the Config App needs to be rerun in order to make SQL Data Catalog run fine after the upgrade.

Improvements

  • Improve performance of a database scan.
  • Added support for SQL Server 2019's Memory-Optmized Tables.

Fixes

  • Fix an issue when clicking between two filters too quickly produces an error.
  • Fix an issue when SqlDataCatalog is not accessible after upgrade

1.7.1 - January 20, 2020

Major changes

Improvements

  • Add Wait-SqlDataCatalogOperation cmdlet to the PowerShell module

API changes

  • API exposes the status of scanning instances and databases

1.7.0 - January 8, 2020

Major changes

  • The Config App needs to be rerun in order to make SQL Data Catalog run fine after the upgrade. This is due to migration of the API from .NET Framework to .NET Core.
  • The encryption mechanism for SQL Server Auth was changed due to the above change. You need to reenter your password if you use SQL Server Auth. See https://www.red-gate.com/data-catalog/update-instance-credentials for more details.

Improvements

  • Improved the UI for bulk classification: to avoid confusion, it is now not possible to modify column selection when the sidebar for classifying multiple columns is displayed.
  • Add 'Masking Data Set' sample tag category to facilitate integration with SQL Data Masker.
  • Security: tighten CORS configuration.
  • Added API documentation to web UI.

Fixes

  • Prevent the 'Something went wrong' error when reloading the Taxonomy page with the sidebar open.

API changes

  • Hyphenate all API endpoints, i.e. auth-tokens, classification-suggestions, sensitivity-label-distribution.
  • The taxonomy endpoints were renamed - all of them are now prefixed with taxonomy and hyphenated, e.g. /tagcategories was renamed to /taxonomy/tag-categories.

1.6.14 - December 24, 2019

Fixes

  • Fixed regression related to the number of suggestions available presented in the instance summary view.
  • Fixed regression where reloading a page doesn't work.
  • Fixed empty audit shapshot when the instance name starts with .\

API changes

  • Removed unused properties from the metadata details of instance and database

1.6.13 - December 18, 2019

Improvements

  • UI: Enforce single-line tag values.

1.6.12 - December 10, 2019

Improvements

  • Now it's possible to easily open the configuration app again after the initial setup finishes.
  • Improved the performance of bulk classification.

1.6.11 - December 3, 2019

Improvements

  • The API now returns security-related HTTP response headers.
  • The built-in Microsoft tags now have descriptions.

1.6.10 - November 26, 2019

Improvements

  • SSL can now be configured using the Configuration app.
  • The API now returns the Content-Security-Policy HTTP header.
  • Audit events are now generated when authorization tokens are created and deleted.

1.6.9 - November 18, 2019

Improvements

  • Enhanced the security of the Web UI

1.6.8 - November 11, 2019

Improvements

  • Tag categories are now displayed in the same order throughout the Data Catalog UI.

Fixes

  • Fixed a bug in the web client that meant changes to a column's freetext attributes might not be immediately reflected in the UI.
  • Fixed a bug where it appeared that suggestions were not applied.

API changes

  • Rename /audit/classification to /audit/export.
  • Rename instances/{InstanceId}/databases/{DatabaseName}/columns/all to instances/{InstanceId}/databases/{DatabaseName}/columns/export.

1.6.7 - November 3, 2019

Fixes

  • Ignore extended properties with NULL values during scans

Changes

  • Remove domain name column from the Permissions grid

1.6.6 - November 1, 2019

Major changes

  • Due to major changes in the permissions handling we recommend you disable permissions before applying this update.

Fixes

  • Don't reset permissions if a user from a different domain is added
  • Allow adding users with the same name but from different domains
  • Do not cache an empty domain list if Active Directory server is down
  • Ensure that the domain provided is taken into account in all scenarios when permissions are granted.
  • Display a message if the user is unauthorized for access Sql Data Catalog.

1.6.5 - October 29, 2019

Improvements

  • Add support for cataloging mirrored databases.
  • Include audit entries of taxonomy changes and requests of an instance scan in the UI.
  • Display the role holder when deleting a user or group on the permissions tab

Fixes

  • Align the plus and the text "Add Instance" on the Catalog page

API changes

  • Export all types of events in a CSV file from the audit log (incl. taxonomy changes and instance scan requests).

1.6.4 - October 22, 2019

Improvements

  • Changes to the taxonomy are now audited.
  • Requesting an instance scan is now audited.
  • The Update-ClassificationInLiveDatabase PowerShell cmdlet now uses the ADD SENSITIVITY CLASSIFICATION syntax when targeting SQL 2019 or Azure SQL.
  • Handle the UPN form of a user name when adding users for permissions.

API changes

  • The columnClassificationAuditEntries field returned from the /audit endpoint has been renamed to auditEntries.
  • The /audit API endpoint takes some new eventFilter values to control which audit data should be returned. For example, setting eventFilter=TaxonomyChanged will return all modifications made to the taxonomy. See the Swagger documentation (at /swagger) for the /audit endpoint for the full list of filters.

1.6.3 - October 14, 2019

Improvements

  • Improve error handling in PowerShell module when invalid tag is provided
  • SQL Data Catalog now reads sensitivity classifications from the sys.sensitivity_classifications table in SQL 2019 and Azure SQL, when the database is first added to the catalog.

Fixes

  • Improve handling of cancelled requests.

Changes

  • Added warning messages about SSL configuration when adding an instance with SQL Server authentication and when configuring SQL Data Catalog
  • Extend default taxonomy by adding a "System" tag to the "Sensitivity" built-in category.

1.6.2 - October 7, 2019

Major changes

  • Permissions list is purged as a result of improving performance on loading permissions list

Improvements

  • Improved performance on loading permissions list

Fixes

  • Support empty collection of columns provided to Set-Classification

API changes

  • Added endpoint DELETE api/v1.0/permissions/domains/{domain}/users/{userSID} for deleting users.
  • PUT api/v1.0/permissions is no longer responsible for deleting users from permissions list.

1.6.1 - September 30, 2019

Fixes

  • Weekly snapshots are now taken as intended (every Sunday).

1.6.0 - September 25, 2019

Major changes

Breaking change of PowerShell cmdlets - most of the cmdlets were renamed, parameters and return types of some of them were changed.
The full list of breaking changes:

  • Use-Classification becomes Connect-SqlDataCatalog
  • Enable-Authorization becomes Enable-SqlDataCatalogAuthorization
  • Add-RegisteredSqlServerInstance becomes Register-ClassificationInstance (-Force param removed)
  • Update-RegisteredSqlServerInstance becomes Set-ClassificationInstanceCredential
  • Start-InstanceScan becomes Start-ClassificationInstanceScan
  • Get-RegisteredInstances becomes Get-ClassificationInstance (return type changed)
  • Get-Databases becomes Get-ClassificationDatabase
  • Get-Columns becomes Get-ClassificationColumn
  • Copy-DatabaseClassification becomes Copy-Classification
  • Export-ClassificationCsv becomes Export-Classification (new -Format param (csv, zip))
  • Export-ClassificationExtendedProperties becomes Update-ClassificationInLiveDatabase
  • Get-TagCategories becomes Get-ClassificationTaxonomy
  • Update-ColumnTags (forceUpdate=off) becomes Add-ClassificationColumnTag
  • Update-ColumnTags (forceUpdate=on) becomes Set-ClassificationColumnTag
  • Import-ColumnsTags (override) becomes Set-Classification

Improvements

  • The 'Auth Tokens' page was improved, the generated auth-token is now fully visible in all browsers.
  • Do not clear the values provided when adding permissions fails.

Changes

  • Moved auth token and permissions navigation menu items from the top bar into Settings.

1.5.2 - September 16, 2019

Improvements

  • The audit trail is now visible from the UI, under Audit -> 'Audit trail'.
  • Permissions are now sorted in access level order on the permissions page.
  • Improved overall performance by cancelling database queries if a request that initiated them was cancelled.
  • Improved performance of the Permissions page.

Fixes

  • Fixed a race condition that could occur when toggling column filters in the UI.

1.5.1 - September 9, 2019

Major changes

Changes

  • Renamed 'Classification' to 'Audit Trail' in 'Audit' menu.
  • Catalog and Taxonomy are now read-only if the application is unlicensed.

API changes

  • Removed two API endpoints: /informationtypes and /sensitivitylabels. Their behaviour was duplicated by the /tagcategories endpoint.

1.5.0 - September 5, 2019

Major changes

  • The powershell that you download from the /powershell endpoint is now signed. This means that you
    will also need to supply the URL for the server to the call to Use-Classification.

1.4.7 - August 28, 2019

Improvements

  • Changed the main navigation menu.
  • Introduced a background update feature. Updates can now be installed through the web UI without needing to interact with the machine itself.
  • Added API endpoint to download classification audit as csv.
  • Classification audit can now be downloaded as csv from UI.

Changes

  • 'See classification suggestions' buttons on database cards are no longer showing for databases that are fully classified. Suggestions can still be accessed from columns page.

1.4.6 - August 20, 2019

Improvements

  • Added new snapshotting feature. A snapshot of all the classifications is automatically taken every month. Snapshots can be accessed via the new 'Audit' page.
  • Added missing descriptions for API endpoints.

Fixes

  • Fixed a bug where the CSV export would timeout when loading a large database.

Changes

  • Admins can view license information on the Settings tab in the License section

1.4.5 - August 14, 2019

Fixes

  • Fixes a bug in the PowerShell functions Import-ColumnsTags and Update-ColumnsTags.
  • Fixed the issue where suggestions are not updated when applying sensitivity labels and info types to columns.
  • Fixed a bug where CSV exports may not work correctly.

Changes

  • The download latest log button now only downloads web API logs.

1.4.4 - August 2, 2019

Fixes

  • Fixed a bug where the CSV export would timeout when loading a large database.

1.4.3 - July 29, 2019

Improvements

  • Improved performance for fetching columns on columns page

Fixes

  • Fix issue when a column was reported as a composite primary key if it was part of more than one index

API changes

  • When using the TagCategories_GetTags API endpoint, if a tag category has no tags a No Content response is received. Previously this would have resulted in a Not Found response, which is the same if a tag category does not exist.
  • Changed the API method from POST instances/{instanceId}/tags to PUT instances/{instanceId}/tags.
  • Changed the request body for PUT instances/{instanceId}/tags, now no longer require categoryId parameter.
  • Change the endpoint from DELETE instances/{instanceId}/tags/{tagId} to DELETE instances/{instanceId}/tags. Now no longer required to provide tagId in the URL
  • All API endpoints return dates in UTC rather than in the offset specific to the server

1.4.2 - July 23, 2019

Improvements

  • Classification table can now be scrolled horizontally when zoomed in
  • Remove "Refresh" buttons from the Instances and Databases views. These views are not cached anymore.

API changes

  • The Permissions API now returns a string for access level, rather than a number.

1.4.1 - July 18, 2019

Improvements

  • Added Classify-only permission level
  • Tags are now sorted alphabetically on the taxonomy page and drop down filters.
  • Added Get-TagCategories function to PowerShell module

Fixes

  • Fixed an issue where bulk classifying columns for which suggestions were available could sometimes fail.
  • Fixed the issue where error messages are still displaying on instance/database cards after a successful rescan.
  • Fixed an issue where row counts would be reported incorrectly.

1.4.0 - July 10, 2019

Major changes

  • This release now includes licensing. The Redgate Client will be installed, and the system will start a 28 day trial.

Improvements

  • Improve performance of loading Instances and Databases views.
  • Added a warning that Internet Explorer is not supported.
  • Added API endpoint to enable restoring a de-registered database.
  • Require the Configuration App to be run as an Administrator.
  • Sidebar can now be closed using the Escape key.
  • Changed database delete message to make it clear that it is reversible.
  • Remove option to select Instance when creating new tag category

1.3.42 - July 1, 2019

Improvements

  • Improve performance of downloading classification in CSV format.
  • Improve performance of fetching columns.

API changes

  • Breaking API change: details about tags and tag categories are not returned anymore in: instances metadata, databases metadata, column classification details.

1.3.41 - June 26, 2019

Fixes

  • Fixed a bug where instance-level tag categories appeared on the column classification page.

Changes

  • Added location header to API responses when creating free-text attributes and tags.

1.3.40 - June 20, 2019

Major changes

  • Database schema is revamped. Please BACKUP THE DATABASE before applying this update. Be patient, it can take up to a few minutes after starting the service to finish the migration. This was done to normalize the database schema and improve the overall performance.
  • Require .NET Framework version 4.7.2 to use the product (bumped from 4.7.1)

Improvements

  • Remove access to log files for read-only users
  • When permissions are enabled, SQL Data Catalog will now automatically grant full access to the current user.
  • Added PowerShell script to get all instances, databases and to start an instance scan for new databases.

Fixes

  • Fixed a bug where Copy-DatabaseClassification PowerShell would fail to copy classification
  • Fixed a bug where the UI would be slow when typing free text into the classification sidebar for bulk classify

Changes

  • Added application version number to logs page, which is renamed to 'Settings'.

1.3.39 - June 11, 2019

Fixes

  • Fixed a bug listing auth tokens, creating free text attribute, deleting tags.

1.3.38 - June 10, 2019

Major changes

  • SQL Data Catalog is now shipped without the web host ('Mosaic') which allowed integration with SQL Clone. The Web UI is now accessible at port 15156, not 3004.
  • Introduced versioning of API. The version for all API endpoints is now 1.0.

Improvements

  • Short-circuit the process of updating the database representation from the live database if the scan result is exactly the same as the previous one

Fixes

  • Changed message in configuration app that incorrectly warned that a database would be overwritten.

API changes

  • Rename field SuggestionsCount to NumberOfColumnsWithSuggestions and TotalSuggestionsCount to TotalNumberOfColumnsWithSuggestions

1.3.37 - June 4, 2019

Major changes

  • The Windows Service "Redgate SQL Data Catalog Service" was renamed from "SEMvNext" to "SqlDataCatalog". This will require entering the username and password for it again. This can be done using the Configuration App that runs just after the installation finishes.

Improvements

  • Now allows adding active directory users to permissions
  • Improve performance of a database scan
  • Improve performance of the suggestions page
  • Do not show buttons in the UI for read-only users

Fixes

  • Fixed a bug where the backing SQL Server was inaccessible but this was not noticed by the validation when the service started.
  • Fixed an issue where the suggestions page doesn't offer user-created tags in the dropdowns

Changes

  • Changed the names of parameters on the API endpoint to update permissions

1.3.36 - May 20, 2019

Improvements

  • Added a button that allows Permissions to be turned off with a single click.
  • Added a helpful error message when unauthorized users attempt to access SQL Data Catalog.

Fixes

  • Support databases with # in their names (including deregistering)
  • Support assets with slash (/) in their names (e.g. a column Middle Name / Initial can be now tagged using both the UI and PowerShell)

1.3.35 - May 15, 2019

Features

  • Added a Permissions page in the UI, for adding and removing Active Directory groups.
  • Introduced a new role for read-only access.

Improvements

  • Improved filtering by tags by using a disjuntion for tags from the same category and conjunction between categories, e.g. ('Confidential' OR 'Highly Confidential') AND ('Production' OR 'Staging'). This change is exposed via the API and through new behavior of the filter bar in the UI.
  • Improved performance of loading the Instances page and the Databases page.
  • Improved performance of fetching columns on the Classification page.

Fixes

  • Fix regression of scanning instances with deregistered databases.

Changes

  • Change application logs location to %ProgramData%\Red Gate\Logs\Sql Data Catalog.

API changes

  • Removed API endpoint PUT /api/{instanceId}/databases/{databaseName}/columns
  • Breaking API change: simplified Metadata property

1.3.34 - May 7, 2019

Features

  • Added API endpoint for enabling permissions feature with PowerShell script function Enable-Authorisation. Enable permissions by specifying an active directory group which can have access to SQL Data Catalog.

Fixes

  • Allow tags in different categories to have the same name.

Improvements

1.3.33 - April 23, 2019

Improvements

  • Do not store results of database scans in the product database anymore. It prevents the database for growing to several gigabytes unexpectedly.
  • Improve the performance of the product by reducing the number of SQL queries required to fetch data, as well as performing more operations on the database side.

Changes

  • Remove property ContainsSensitiveData from the API.
  • The web app no longer runs under IE 11. We have never officially supported IE 11, but it is possible that the app did used to run on the platform - this is now no longer the case.

1.3.32 - April 18, 2019

Improvements

  • Individual databases can now be rescanned using the API and through the UI.
  • Improved the data type filter: sorted the list of types alphabetically, added data types like nvarchar without brackets, allowed to filter by multiple data types at the same time, and fixed the 'Clear filters' functionality.

Fixes

  • Fixed a bug where classification isn't pushed to extended properties correctly via PowerShell when forceUpdate switch is off

1.3.31 - April 11, 2019

Features

  • Added PowerShell script to push sensitivity labels and info types to live databases

Improvements

  • It is now possible to filter columns by tag and data type from the columns page in the UI.

Fixes

  • Fixed a bug where Import-ColumnsTags and Update-ColumnTags PowerShell would fail to update SQL Data Catalog.

1.3.30 - April 10, 2019

Features

  • Add ability to update a password for SQL Server Authentication using a new PowerShell cmdlet Update-RegisteredSqlServerInstance.

Improvements

  • Added table row count column in CSV report
  • Replaced the filter bar on the columns page with a new version with much better usability.

1.3.29 - April 1, 2019

Features

  • A CSV file containing all the columns in an instance can now be downloaded through the UI and PowerShell.

Fixes

  • Fixed a bug where DataCatalog would fail to start for non admin user.
  • Fixed a bug where the web UI will be blank for 2 minutes after clean install.

Improvements

  • In the UI, the scroll position is now restored after applying tags to a column.
  • The exported CSV file now includes free-text attributes, including MS_Description.

1.3.28 - March 27, 2019

Features

  • Support SQL Server Authentication for both on-premises and SQL Azure databases.
  • Added Export-ClassificationCsv function to PowerShell module

Improvements

  • Editing a tag category or free text description can now be done via an on-hover 'edit' link, rather than clicking on the category/description name itself.

Fixes

  • Fixed a bug on the column retrieval endpoint where setting 'take' to 0 caused an exception.
  • Added length to other datatypes where it was missing.
  • Fixed a bug where the default taxonomy failed to be populated.

1.3.27 - March 21, 2019

Features

  • It is now possible to add tags to the built-in Microsoft categories, 'Information type' and 'Sensitivity label'.

Fixes

  • Fixed the issue that returns all the columns from all databases when trying to fetch columns for a given database

1.3.26 - March 21, 2019

Features

  • Added the ability to download a CSV file of all columns and tags in a database.
  • Extended columns' data type by including max length, precision and scale, e.g. data type is now "nvarchar(20)" instead of "nvarchar" and "numeric(12, 2)" instead of "numeric".

Improvements

  • The instance and database lists will now not refresh every time they are visited; it must be refreshed manually instead.
  • Improved performance of fetching columns on columns page.
  • Improved perfomance of Get-Columns PowerShell cmdlet

1.3.25 - March 12, 2019

Improvements

  • 'SQL Estate Manager vNext' is now officially 'SQL Data Catalog'.
  • Added a Getting Started modal dialog that describes how we recommend to get started with classification.
  • For new users and those users who have not modified their taxonomy, the tool is now seeded with an example taxonomy.
  • Removed New Tag button from platform taxonomy
  • Updated taxonomy page style for New Category, New Attribute, New Tag buttons

Fixes

  • Fixes a bug when Update-ColumnTag PowerShell is used with empty tags and --forceUpdate switch.

1.3.24 - March 6, 2019

Improvements

  • Improved databases page load times

Fixes

  • Fixes a bug where the service would fail to startup after being upgraded from an older version.

1.3.23 - February 27, 2019

Improvements

  • Instance and database scan progress updates are now displayed on the instance and database cards.
  • Introduced a new API endpoint and UI functionality to delete individual databases from the catalog.

Fixes

  • Filtering by table or column name now returns the paginated column list to the first page of results.

1.3.22 - February 14, 2019

Changes

  • Require .NET Framework ver. 4.7.1 to run the application (bumped from 4.6.1)
  • Change application logs location to %LOCALAPPDATA%\Red Gate\Logs\SqlEstateManager-vNext, change format of the logs from JSON to plain text

Features

  • Added Import-ColumnsTags and Copy-DatabaseClassification functions to PowerShell module

Improvements

  • Improved instance page load times

1.3.21 - February 4, 2019

Features

  • Add the ability to bulk classify columns
  • PowerShell module can now be downloaded from http://{dpp-server}:15156/powershell

1.3.20 - January 28, 2019

Features

  • Filter columns by including, excluding or requiring them to be a Primary Key, Foreign Key, Composite PK and Identity.
  • Enable showing only empty tables or only columns with tags.

Improvements

  • Columns page now displays Data type of columns

1.3.19 - January 23, 2019

Features

  • Filter by column name by entering a search term in the filter bar.
  • In PowerShell, columns can now be filtered using TableRowCount and column DataType properties, as well as constraint properties: IsPrimaryKey, IsIdentity, IsCompositeKey, IsForeignKey.

Fixes

  • Fix for database scan recording empty scan result

1.3.18 - January 21, 2019

Features

  • New API endpoint to retrieve tags assigned to a single column

Fixes

  • The ms_description extended property for columns is now captured during database scanning, which means it is once again present in the edit column sidebar.

1.3.17 - January 16, 2019

Features

  • New filtering options on the columns page: tagged columns and columns belonging to empty tables can be hidden
  • Instance scan can now be manually triggered

Improvements

  • The taxonomy page now makes clear the distinction between the Microsoft-provided taxonomy and the SQL Data Catalog taxonomy.
  • The number of items per page on the column and suggestion lists now persists between browser sessions.
  • Updated API documentation.
  • The support for migration from the previous file based state storage system has been removed. Users who need support should upgrade to v1.3.15 first to run the migration, and then the latest.

1.3.16 - January 8, 2019

Fixes

  • Fixes the issue that some customers are no longer able to access instances

1.3.15 - January 8, 2019

Features

  • Free text attributes can now be created (on the taxonomy page) and applied to columns.

Improvements

  • Application no longer queries live instances for databases and database schemas. Instead, live instances registered to the application are scanned routinely for the most updated schema. The application shows the information retrieved from the latest scan.
  • Classification distribution data on the charts are updated in real time now.
  • Application will now store the sensitivity labels and info types from the extended properties in the first scan of the databases into the application data storage. Any scans afterwards will not affect classifications stored in the application data storage.

1.3.14 - December 21, 2018

Improvements

  • Newly-added instances can now not be used to classify databases that are in availability groups.
  • The breadcrumb trail in the application now shows the name of the instance and database with which you are working.
  • To make navigation easier, pagination controls are now at the top and bottom of the column and suggestion tables.

1.3.13 - December 5, 2018

Improvements

  • Display on the instances page whether an instance is an availability group listener or a normal instance.
  • Display the version of the instances on the instances page.

1.3.12 - December 3, 2018

Features

  • Add support for availability groups. It is now possible to add availability group listeners as instances in the data catalog. Only databases within that availability group can be classified inside that availability group listener.

Improvements

  • The ms_description field is now visible on the edit column form if and only if the column has a description.
  • The pagination control on the column and suggestions lists now shows the total number of columns, allows jumping to a particular page of results, and allows setting the number of results per page.

Fixes

  • The URL now updates correctly when navigating within the application.

1.3.11 - November 27, 2018

Fixes

  • Fixed a bug preventing some column tags being edited through the UI.

1.3.10 - November 26, 2018

Features

  • Introducing the additional token based authentication mechanism in order to consume REST APIs properly outside the Web UI. Please refer to https://www.red-gate.com/data-catalog/working-with-rest-api for more information.
  • Multi-value tag categories. When you create a new tag category, you can now choose to allow multiple tag values to be assigned to a column.

Improvements

  • The default font size across the application has been made smaller in order to increase information density.
  • The column and suggestions lists are now much more dense and support row and click highlighting.
  • Classification suggestions should now provide some more suggestions for common PII column names/types.

1.3.9 - November 20, 2018

Improvements

  • When applying classifications to columns, the refresh will now respect the current page rather than always returning to the first page.
  • Added pagination mechanism on the classification suggestions page.

Fixes

  • Fixed a bug where applying multiple suggestions would sometimes fail.
  • Reduced the amount of logging to save disk space and make analysis of bugs easier.

1.3.8 - November 9, 2018

Improvements

  • Moved the pagination controls on the columns page to free up some screen space.
  • When creating a new tag category, the default choice is for the category to apply to columns, rather than instances.
  • It is now possible to delete both individual tags and whole tag categories, even if they are currently in use.

Fixes

  • Fixed an issue where it wasn't possible to remove an instance if any tags had been applied to it.

1.3.7 - November 8, 2018

Improvements

  • Now retrieves and displays value of the MS_Description extended property on columns page.

1.3.6 - November 7, 2018

Improvements

  • Fixed a bug in which the user couldn't change the classification storage of a database.

1.3.5 - November 6, 2018

Improvements

  • Improved the index page in order to make aware the user if there is an error on the back-end.
  • Added the ability to add new instances through the UI, via the 'Add instance' link on the instances page.

1.3.4 - November 5, 2018

Improvements

  • Added user input validation at the configuration app to prevent some errors in the Windows service.
  • No longer possible to add tags to 'Sensitivity label' and 'Information type' tag categories.

1.3.3 - October 29, 2018

Improvements

  • Allows custom tags to be assigned to columns.
  • Support free text description on tags and tag categories. While the user creates a tag or a tag category from the tags page, is able to attach a description to them.
  • Improved robustness in SQL Data Privacy Suite service, to reduce the probability of it needing to be restarted.

1.3.2 - October 16, 2018

Changes

  • EAP timebomb to go off on the 19th of November, instead of 11th of October.

Improvements

  • Open the taxonomy and allow the creation and deletion of tag categories and tags. At the moment, we support the assignment of a tag category to two asset types, the Instance and the Column, and we don't support multiple asset types. Furthermore, the "standard" tag categories cannot be deleted. This is likely to be temporary, until we eliminate all remaining parts of the UI that depend on the existence of Environment, Sensitivity Label and Information Type categories.

1.3.1 - October 8, 2018

Improvements

  • Classification capability now uses SQL Server as its state storage. The migration from the previous file based state storage system should happen during the startup if necessary.
  • Windows service account credentials can now be configured during the installation through the Configuration Setup window.

1.2.8 - September 28, 2018

Improvements

  • Removed following unsupported REST APIs to prevent confusuion: /apis/labels, /apis/labelcategories, /apis/objectLabelassignments
  • Removes the unsupported and unused PATCH /api/instances/{id} HTTP API to prevent confusion
  • Modified API to add support for searching columns by multiple tables
  • Column search functionality now allows multiple tables to be filtered

1.2.7 - September 7, 2018

Improvements

  • Displaying information about capabilities under SDPS such as name and version of the capability inside the about page within the Web interface.
  • Now allowing easy way to download the log files for Classification capability from the web interface in order to make it easier to troubleshoot problems.
  • Display a modal dialog when the user leaves the classification workflow having unsaved changes.
  • The button on the suggestions page now tells you how many suggestions you are about to apply.

1.2.6 - September 3, 2018

Improvements

  • Fixes the issue where connections to databases were being kept open unnecessarily.
  • Adds a more informative error message when an error occurred attempting to connect to an individual database.
  • Changes to the background scanning and caching algorithm to reduce the previously high CPU usage of the Windows service by default. These values can also be configured per installation. Please refer to https://www.red-gate.com/data-catalog/application-settings for more details.

1.2.5 - August 31, 2018

Improvements

  • Fixes the issue where all available table names were not showing up for table filtering functionality inside the classification workflow.

1.2.4 - August 30, 2018

Improvements

  • Provides a mechanism to override the FQDN for individual capabilities to be accessible outside the installed server when FQDN cannot be determined accurately (e.g. when the server is not joined to AD, etc.). See Installation Instructions for more information: https://www.red-gate.com/data-catalog/overriding-fqdn

1.2.3 - August 29, 2018

Improvements

  • Left hand side navigation on Web UI now has contextual information when it's collapsed.
  • Added pagination mechanism on the columns page.
  • Error handling when fails to retrieve columns for databases and/or fails to apply classifications to columns in classification capability
  • Now surfacing potential Windows Service permission issues on the Web UI.

1.2.2 - August 22, 2018

Improvements

  • Fixed issue where the installer would require users to manually stop the service before proceeding to upgrade to a newer version.
  • URLs now persist on the browser address bar to allow pages to be shared and be refreshed while landing back on the same place within the workflow.
  • A new PowerShell module is available that can be used to register SQL Server instances. See https://www.red-gate.com/data-catalog/inventory-registration for details.

Features

  • Allows storing classifications in external repository.

1.2.1 - August 17, 2018

Features

  • Allows for the deletion of SQL server instances from the Web UI.

1.2.0 - August 10, 2018

Improvements

  • Fixes the issue where Classification Web UI wasn't working as expected when accessed from a remote client.

1.1.12 - August 10, 2018

Improvements

  • Fixes an installer issue whereby appropriate permissions were not being granted to the common data folders for log files and the data storage folder.
  • Fixed the issue that it shows blank page on entry.

1.1.9 - July 9, 2018

Features

  • Inventory registration feature has been implemented through API in SQL Estate Manager vNext Web UI.

1.1.8 - June 27, 2018

Improvements

  • Optimised the performance of SQL Estate Manager vNext Web UI. When metadata about instances or databases are requested, instead of retrieving this metadata from the requested live instances/databases, it is now retrieved from an in-memory cache.

Features

  • Environment tagging feature has been implemented for SQL Estate Manager vNext Web UI. Users can be able to tag the SQL Server instances in the inventory by environment.

1.1.7 - June 19, 2018

Improvements

  • Users are now able to see the number of suggestions on databases screen and navigate directly to suggestions list.
  • The databases on the databases screen are now ordered by the number of suggestions in the database.
  • We now display the fully-qualified host name of SQL Server instances.
  • Added settings page.
  • Users are now able to download the latest log file from settings page.

1.1.6 - June 12, 2018

Improvements

  • Significant performance improvement for many operations in the Data Classification Web UI.
  • Improved platform compatibility.

1.1.5 - May 23, 2018

Improvements

  • Users are now able to see the number of suggestions on databases screen and navigate directly to suggestions list.
  • The databases on the databases screen are now ordered by the number of suggestions in the database.
  • We now display the fully-qualified host name of SQL Server instances.
  • Added settings page.
  • Users are now able to download the latest log file from settings page.
  • The "Apply suggestions" and "Apply changes" buttons are now always visible in the Suggestions and Columns pages.
  • Added columns' sensitivity label distribution at instance level. Users will now be able to see how their columns are labelled for all databases in a particular instance, allowing better control at a higher level.
  • Fixed an issue involving duplicate instances. This builds upon an earlier fix in 1.1.3, whereby we've found a situation where an instance could be manually added more than once.

1.1.3 - April 23, 2018

Features

  • SQL Estate Manager Data Classification Web UI now displays the instance name for databases list view.
  • Details of database connection errors (e.g. incorrect credentials) are now made available in the UI.

Improvements

  • Fixes an issue where SQL Estate Manager Data Classification Web UI was ignoring the connection port setting when establishing a connection to a monitored SQL Server instance that had been configured with a non-default port.
  • Fixes an issue where SQL Estate Manager Web UI doesn't show all table names within the table filter for the columns inside the Data Classification workflow.
  • Resolves the issue of showing duplicate SQL Server Instances inside the Data Classification Web UI in cases when an instance has been added both manually and by an automatic domain scan

1.1.2 - April 16, 2018

Improvements

  • Fixes the issue of SQL Estate Manager Data Classification Web UI failing for the sessions when the first time authentication also happens.
  • Fixes the issue of SQL Estate Manager Data Classification Web UI failing to open under IE 11.
  • SQL Estate Manager Data Classification Web UI now correctly handles directly serving the non-root URL paths.

1.0.4 - April 9, 2018

Features

  • New preview data discovery and classification feature. See the documentation for instructions on how to enable this feature.

Didn't find what you were looking for?