Documentation

gitHub

v6.x

New features in v6.8.4 [20-Jan-2023]

- Workgroup Edition: added ability to STASH local changes from the commit screen, plus review, apply, drop, handle conflicts

- PDF documentation and PDFdiagram print: replaced PhantomJS library for enhanced performance and increased stability

- JSON Schema: added user-friendly "Display name" property for conditionals for documentation purposes (not forward-engineered, as not part of spec)

- JSON Schema: prevented possibility to use copy/paste workaround to create multiple conditionals at same level

- Avro/Parquet reverse-engineering from cloud storage: set default to combine schemas

- Avro/Parquet reverse-engineering from cloud storage: increased logging of critical operations

- BigQuery: added configuration of external table options, plus forward- and reverse-engineering of external table options 

- BigQuery: added support for new JSON data type

- BigQuery: disabled ability to create multiple data types for a columns

- BigQuery: disabled possibility to create pattern columns, while leaving the possibility inside a column with JSON data type

- Couchbase: enabled possibility for numeric fields to be marked as primary key of document type for documentation purposes

- Couchbase: adjusted reverse-engineering logic to continue process after failure to fetch documents from N1QL query

- MariaDB: added validation warning for empty index names

- MySQL: added handling of tablespaces

- MySQL: added Blackhole engine

- MySQL: added validation warning for empty index names

- PostgreSQL: added array type for domain data type

- PostgreSQL: added forcing user to create UDT according to spec for data types domain, enum, composite, and range_udt https://www.postgresql.org/docs/current/datatype-enum.html

 

New features in v6.8.3 [13-Jan-2023]

- References: added shortcut to root level objects or dialog for nested objects in internal and model definitions when adding, inserting, appending

- Azure Data Lake Storage: improved performance when reverse-engineering Avro, JSON or Parquet files in nested sub-folders

- Avro: added name property when resolving UDTs

- Avro: adjusted resolution of references with multiple data types

- Couchbase: allowed fallback on N1QL for index retrieval if issues encountered in retrieval via REST API

- MySQL: implemented generation of ALTER script from delta model

- OpenAPI/Swagger/EventBridge:allowed additional ways to create FK relationships (for documentation purposes) in Schema ERD View tab

- PostgreSQL: added visual display for array types in ERD

- Synapse: added handling for empty tableInfo data and null table_type

 

New features in v6.8.2 [05-Jan-2023]

- JSON Schema forward-engineering: adjusted filtering of nested definitions when one is undefined

- Avro: allowed Doc property of a definition to be replaced by reference description

- Databricks: adjusted count of number of table buckets when reverse-engineering from HQL file

- Elasticsearch: added reverse-engineering from cloud instance

- Glue Data Catalog: adjusted count of number of table buckets when reverse-engineering from HQL file

- Hive: adjusted count of number of table buckets when reverse-engineering from HQL file

- Parquet: improved speed of reverse-engineering on Azure Data Lake Storage

- Synapse: improved detection of parent schema of views

 

New features in v6.8.1 [30-Dec-2022]

- Excel: added full path in technical names of nested objects

- Delta Lake/Databricks: added handling of view table properties, plus added numBuckets cast to number

- Glue Data Catalog: added handling of view table properties, plus added numBuckets cast to number

- Hive: added numBuckets cast to number

- PostgreSQL: added support for v15, including new property NULLS [NOT] DISTINCT for columns, table constraints and table indexes

- PostgreSQL: added support for array types

- Synapse: added reverse-engineering of views referencing tables in other schemas, and of views in schemas without tables

 

New features in v6.8.0 [23-Dec-2022]

- MySQL: added plugin with full support for forward-engineering of DDL, and reverse-engineering including inference of schemas in LONGTEXT data types

- Tech refresh of Electron (v22.0.0), NodeJS (v16.17.1), Chromium (v108.0.5359.62), V8 (v10.8) and Electron-related modules

- Mac: fixed shortcut key conflict on Ventura MacOS after screen capture

- Schema Registries: fixed issue in selection modal when version labels sometimes overlapped when filter is active

- Cassandra/ScyllaDB: adjusted ALTER script in case of change in Clustering Key

- MongoDB/DocumentDB/Cosmos DB with MongoDB API: enhanced BSON parser

- Neo4j and other graph targets: fixed alignment of nodes when not using forced-directed layout

- PostgreSQL: adjusted parsing of SELECT statements to allow view columns with no underlying table columns (NULL::character varying AS...)

- PostgreSQL: enhanced reverse-engineering in case of duplicate views in same DDL

- Redshift: enhanced handling of deactivated columns in forward-engineering

- Swagger/OpenAPI/EventBridge: enabled copy/paste in responses of interactive SwaggerUI pane

 

New features in v6.7.3 [16-Dec-2022]

- Tools > Options > Forward-Engineering: added parameter to skip COMMENT in DDL for SQL and SQL-like targets

- Reverse-Engineering selection dialog: adjusted filter so schema versions don't require matching

- Undo/Redo: various enhancements

- Workgroup: added basic support for git subtrees

- Workgroup: added possibility to commit and push in a single step, provided that there are commits to be pulled first

- Workgroup: updated simple-git library to latest version

- Workgroup: adjusted SSH password prompt modal

- Workgroup: added logging of git configuration when opening a repository

- Avro: added inference of Subject Name Strategy during reverse-engineering of Confluent Schema Registry

- Cassandra: added determination of PROFILE value from DESCRIBE SEARCH INDEX during reverse-engineering

- Cassandra: removed from ‘Profile’ <spaceSavingNoTextfield> for CQL if DSE version is 6 and higher

- Cassandra/ScyllaDB: added tolerance for empty lists in reverse-engineering of UDTs

- Cassandra/ScyllaDB: moved data transfer to UDThelper

- Cassandra: added check ‘Profile’ values - <spaceSavingNoTextfield> and <spaceSavingSlowTriePrecision> if they are missing in the reference model

- PostgreSQL: improved parsing of complex functions during reverse-engineering

- Protobuf: added conversion of array attributes from Polyglot

- Swagger/OpenAPI: enabled auto-height and auto-width for entities in Schema ERD View

 

New features in v6.7.2 [09-Dec-2022]

- Added validation warnings in ObjectBrowser and ERD for deeply nested attributes

- Workgroup Edition: after creation of Pull Requests, redirect user to My Pull Requests screen

- Workgroup Edition: added provider-specific help links in Repository Connections dialog

- Workgroup Edition: added rendering of Pull Request timeline in ascending order for GitHub and GitLab

- Avro: refactored integration with Confluent Schema Registry to better handle different subject name strategies

- Avro: added capture of Schema Registry URL during reverse-engineering from Confluent

- Avro: added generation of subject name according to strategy and schema type unless specified manually

- Avro: added validation for Topic and Subject properties

- Collibra: added more user-friendly dialog when attempting to connect with an erroneous URL

- Delta Lake/Databricks: added support for columns GENERATED AS

- Swagger/OpenAPI: allowed display options in Schema ERD View

- Swagger/OpenAPI: added import of FK relationships when deriving Polyglot model into Schema ERD View

 

New features in v6.7.1 [02-Dec-2022]

- Polyglot: added normalization of Polyglot choices during derivation into super-type/sub-type for RDBMS targets

- Polyglot: added creation of references to Polyglot model when converting a target model to Polyglot

- Compare and Merge: disabled rendering of properties for ghost objects

- Workgroup Bitbucket Server: enabled network proxy settings, so self-signed certificates in local store are automatically recognized

- Avro: added support for newly introduced Avro spec feature of symbol default property for enum data type

- Delta Lake/Databricks: added Azure URL suffix in connections dialog for Azure Storage Access

- ScyllaDB: applied recent ALTER script logic enhancements from Cassandra plugin for partitioning/clustering keys

- Snowflake: updated snowflake-sdk package in plugin

- SQL Server: allowed creation of Foreign Relationships referencing columns that are non-PK as long as they have a UNIQUE constraint

- Swagger/OpenAPI/EventBridge: added parsing of yaml values as JSON

- Swagger/OpenAPI/EventBridge: added validation of objects after reverse-engineering to display warning badges in Object Browser

 

New features in v6.7.0 [25-Nov-2022]

- Workgroup: added support for GitLab Cloud (gitlab.com) and GitLab Server (self-hosted) for workflow to submit and review Merge Requests

- Workgroup: added showing username and display name for change requests

- Workgroup Bitbucket Cloud: enabled network proxy settings

- Network proxy: added possibility to specify a .pac file URL for backend functions such as forward- and reverse-engineering

- Compare and Merge: adjusted matching for objects inside moved objects

- Excel: adjusted handling of multiple JSON complex types

- Avro: reverted mapping of date/time/timestamp fields to semantic meaning when converting from DDL and JSON Schema and inference of JSON data

- Cassandra: removed duplicated udt in list/set/tuple when reverse-engineering from instance

- Cassandra: removed business and technical names from array items to keep just display name

- Delta Lake/Databricks: allowed column lists to be used for aliases as well as filter of columns from SELECT statements when reverse-engineering from instance

- Hive: added forward- and reverse-engineering of AS SELECT statement for views

- Hive: added forward-engineering of comments

- OpenAPI/Swagger: added lower tab "Schema ERD view" to enhance visualization of definitions/component schemas

- Parquet: reverted mapping of date/time/timestamp fields to semantic meaning when converting from DDL and JSON Schema and inference of JSON data

- ScyllaDB: removed duplicated udt in list/set/tuple when reverse-engineering from instance

- ScyllaDB: removed business and technical names from array items to keep just display name

 

New features in v6.6.4 [18-Nov-2022]

- Polyglot: added possibility to insert attributes in entities of target model derived from Polyglot

- Polyglot added impact analysis when calling references refresh from entities

- Network proxy: added possibility to specify a .pac file URL for access to license server and plugin manager

- Network proxy: enhanced logging of proxy settings on application startup

- Workgroup Bitbucket Server: added tolerance for slashes in usernames when displaying Pull Requests

- Custom properties: allowed defaultValue property in custom tabs

- Cassandra: adjusted reverse-engineering of list<udt>, and adjusted ALTER script generation in case of list<udt>

- Cassandra: fix over eager drop/create table when business names are different but technical names are similar

- Databricks on Azure: added connection tab to declare ADLS storage passthrough credentials

- Neo4j and other graph targets: allowed dragging graph nodes with force-directed layout if node has edge is dangling

 

New features in v6.6.3 [11-Nov-2022]

- Command-Line Interface: added command polyglotDerive to derive a target model from multiple polyglot models

- Compare and Merge: allowed comparison by name to take array display names into account

- Polyglot: added possibility to derive target model when FK relationships involve attributes in nested objects

- Workgroup for Azure DevOps Repos: added ability to automatically detect and use proxy settings

- Workgroup Bitbucket Server: detect Server version to adapt required connection parameters accordingly

- Workgroup Bitbucket Server: show detailed message in logs in case or API errors

- Cassandra: adjusted ALTER script generation when change in PK

- Delta Lake/Databricks: added property Column List in view Properties Pane to achieve round-trip engineering

- Delta Lake/Databricks: added parsing of column list from CREATE VIEW statement in HQL file

- Delta Lake/Databricks: allowed column lists to be used for aliases as well as filter of columns from SELECT statements when reverse-engineering from HQL files

- Delta Lake/Databricks: added handling of jinja double curly braces in forward-engineering and ALTER scripts

 

New features in v6.6.2 [04-Nov-2022]

- Command-Line Interface: added command polyglotDerive to derive a target model from a polyglot model

- Command-Line Interface: added command polyglotUpdate to update a target model for modifications made to the referenced polyglot models

- Command-Line Interface: added possibility to forward-engineer schema to schema registries (Confluent, Azure, Pulsar)

- Documentation: fixed issue generating PDF on Ubuntu 24.04

- Model API generation: added validation of the template to ensure presence of entity/entities in schema components and resources

- MongoDB: fixed issue with $jsonschema generation when descriptions include Regex-like expressions

- Workgroup: enhanced handling of user permission errors when submitting change request for review

 

New features in v6.6.1 [28-Oct-2022]

- Workgroup: added display of required permissions in the connection manager when issues with the Personal Access Token

- Workgroup: changed check of repository permission to circumvent lack of proper decoding of slashes in usernames by Bitbucket Server

- Workgroup: added check for repo permissions when opening Submit for review page, and when switching repos

- Workgroup: streamlined flow after repo provider authentication error 

- Workgroup: added input auto-height when typing multi-line comments in change requests creation and review

- Workgroup: harmonized icons for closed and reopened Change Requests in timeline and status badge

- Workgroup: added preserving reviewers when switching panes during Change Requests

- Workgroup: improved SSH keys errors and SSH URLs handling

- Polyglot: fixed refresh of cross-target external reference after conversion to local objects

- Polyglot: default to ER Diagram tab when opening previously save model

- Avro: adjusted mapping of detected ISO-8601 dates in JSON data reverse-engineering

- EventBridge: added ability to add recursive references to resource schemas

- OpenAPI: added ability to add recursive references to resource schemas

- Parquet: adjusted mapping of detected ISO-8601 dates in JSON data reverse-engineering

- PostgreSQL: adjusted mapping of timestamps without timezone

- Redhift: adjusted mapping of detected ISO-8601 dates in JSON data reverse-engineering

- YugabyteDB: adjusted mapping of detected ISO-8601 dates in JSON data reverse-engineering

 

New features in v6.6.0 [21-Oct-2022]

- Workgroup: added support for Azure DevOps Repos for workflow to submit and review Pull Requests

- Polyglot: added lower tab Graph Diagram view for conceptual modeling

- Collibra: added storage of Asset URL for objects during reverse-engineering

- Avro: refactoring of forward-engineering to facilitate enhancements

- Avro: added detection of conflict in names of references and records

- Avro: added detection of missing type name for fixed fields

- Avro: adjusted level for generation of alias of arrays

- Avro: adjusted resolution of array references

- Avro: adjusted order of doc property in case of array with aliases

- Avro: added possibility to create complex schemas to fields with map data type

- Avro: added handling of choices with empty names

- Avro: resolved duplicate named complex types with different structures

- Cassandra: added filtering in views of columns that have been deactivated in the underlying table

- Delta Lake/Databricks: added warning dialog when views are invalid due to discrepancy with underlying table structure, and need to be refreshed

 

New features in v6.5.5 [14-Oct-2022]

- ERD: added logic to automatically create PK in parent table if not exists, when FK relationship is created via drag-and-drop

- Test data generation: upgraded to FakerJS v7.6.0 library

- Test data generation: added tolerance for wrapping functions with quotes instead of backticks

- Markdown documentation generation: fixed to take out link rule in turndownHelper to speed up generation

- Workgroup Edition: added handling of non-scp syntax for SSH protocol in remote URL of git config file

- DDL reverse-engineering: added handling of integer and decimal type of SQL Server T-SQL dialect

- Collibra: added handling for deactivated objects in publishing and reverse-engineering

- Avro: added handling of fixed type when size is zero

- BigQuery: added filtering in views of columns that have been deactivated in the underlying table

- Delta Lake/Databricks: added parsing of properties pane SELECT statement to determine view columns

- Hive: added filtering in views of columns that have been deactivated in the underlying table

 

New features in v6.5.4 [07-Oct-2022]

- YugabyteDB with YSQL API: added plugin with full support for forward-engineering of DDL, and reverse-engineering including inference of schemas in JSON and JSONB data types

- Workgroup: added filter by file extension for custom certificate selector

- Workgroup: pre-filled host domain for self-hosted providers with info from opened git repo

- Workgroup: only allow pem,crt,key,cer file extensions when specifying custom SSL Certificate Authority for Git and Git provider API

- Delta Lake/Databricks: enhanced reverse-engineering by querying long list of properties in struct data type

- Delta Lake/Databricks: added possibility to reverse-engineer a view that references tables in another Databricks database

- MongoDB: added choice between JSON or BSON serialization in data sample of Preview, forward-engineering, and Command-Line Interface

 

New features in v6.5.3 [30-Sept-2022]

- Workgroup: added support for Bitbucket Cloud for workflow to submit and review Pull Requests

- Workgroup: improved handling of custom Certificate Authority

- Enum and other multi-text inputs: added bulk edit functionality

- JSON Schema reverse-engineering: added detection and tolerance for UTF-16 encoding

- JSON Schema: added support in choice subschemas to convert to definition, replace by attributes, and replace by attributes

- Avro: adjusted type for references in array items

- Cassandra: added filtering of solr_query column during reverse-engineering

- Cassandra: added searchIndexProfiles to excluded keys in model comparison and generation of delta model

- Delta Lake/Databricks: made "if not exists" and "or replace" mutually exclusive

- Delta Lake/Databricks: added filtering in views of columns that have been deactivated in the underlying table

- Delta Lake/Databricks: enhanced representation of table properties, converting from textarea to key-value pairs

- Hive: made "if not exists" and "or replace" mutually exclusive

- MongoDB: enhanced forward-engineering to Mongoose schema so only relevant definitions are included when choosing separate files option

- OpenAPI/Swagger/EventBridge: added possibility to resolve external references when forward-engineering, in GUI and Command-Line Interface

 

New features in v6.5.2 [23-Sept-2022]

- Polyglot: added an impact analysis screen when updating references from polyglot in a target model, based on the model compare screen

- Workgroup: added possibility to specify custom SSL Certificate Authority for Git and Git provider API

- Enum and other multi-text inputs: added up/down controls to re-order list

- ERD annotations: added an Options tab to control color and font style

- Forward-engineering of ALTER script from delta model: added user-friendly message if script is empty

- DDL reverse-engineering: adjusted mapping of timestamp, time, and numeric data types for DB2 dialect

- Delta Lake/Databricks: enhanced reverse-engineering of cross-database views when script does not include related tables

- Delta Lake/Databricks: improved parser of view statements with CAST of STRUCT when reverse-engineering from HQL file

- Delta Lake/Databricks: improved parser of view statements with subqueries in FROM section of SELECT statement

- MongoDB: enhanced forward-engineering of numerics (int32, long, double, decimal128) to be formatted as BSON instead of JSON

- Redshift: added possibility to connect to instance without region if stored by AWSCLI

- Snowflake: added to ALTER script from delta model: schema and table rename, comment set/unset, view add, drop and rename

 

New features in v6.5.1 [16-Sept-2022]

- Changed some icons of Display options to be more intuitive and consistent

- JSON Schema: added support for "dependent schemas" property when both business/technical names are present

- JSON Schema: added tolerance for "example" keyword during reverse-engineering for draft-06 and above, when the keyword should have been "examples"

- JSON Schema: added support for references in choice subschemas

- DDL reverse-engineering into Avro target: adjusted mapping of dates and decimal numbers data types 

- DDL reverse-engineering: adjusted handling of $$ comments for Snowflake dialect

- Workgroup edition: implemented automatic transparent use of of repository connection credentials in Git clone, if previously provided for provider

- Workgroup edition: added tooltip next to Clone button to describe URL pattern

- Workgroup edition: update styles and layout of history details to match the "Repository files" screen

- Cassandra: adjusted handling of ALTER script for default values in search index

- Delta Lake/Databricks:added extra logging, plus stopped querying count in case of absolute sampling in reverse-engineering

- Redshift: added possibility to connect to instance without credentials if stored by AWSCLI

- Snowflake: added filtering of metadata columns for external tables during reverse-engineering

 

New features in v6.5.0 [09-Sept-2022]

- Workgroup: added support for Bitbucket Server for workflow to submit and review Pull Requests

- JSON Schema: added support for "dependent required" property when both business/technical names are present

- Collibra: added handling of multiple choice subschemas during reverse-engineering

- Delta Lake/Databricks: enhanced parsing of views to handle CAST statements

- Redshift: added support for serverless instances

- Snowflake: added detection of insufficient rights to perform reverse-engineering and display user-friendly dialog

 

New features in v6.4.3 [02-Sept-2022]

- FK relationships: added display option to toggle relationship names in ERD

- Compare and Merge: added user-friendly dialog if user chooses models for different targets

- Compare and Merge: if comparison by GUIDs is not possible, changed default to comparison by technical name (if exist) when generating delta model, instead of business names

- Compare and Merge: display placeholder when models only differ by their metadata

- Compare and Merge: difference pager count takes display filter into account

- Compare and Merge: when invoked from the Commits History view, added possibility to Open model in new instance

- Cassandra: added filter for table options in ALTER script of delta model

- Oracle: added support for ON DELETE for FK relationships

 

New features in v6.4.2 [26-Aug-2022]

- Infer Primary Keys and Foreign Key relationships: increased probability to infer FKs in some conditions, while restricting other conditions to reduce false positives

- Foreign Key relationship: swapped order of entities in automatic naming to follow a more common convention: fist table is the FK table, and second table is the PK table

- Model API: added user-friendly dialog if user chooses inadequate file for API template

- Collibra: added support for multiple JSON Schema choices in same table

- Workgroup: made column width adjustable in Explore Repository Files screen

- Workgroup: allowed to review closed Change Requests when remote branch has been deleted

- Workgroup: added visual clue that a copy icon is being clicked

- BigQuery: added filtering of deactivated objects in forward-engineering of DDL in JSON Schema format

- Delta Lake/Databricks: added support for table options reverse-engineered from instance

- Delta Lake/Databricks: added maintaining order of fields when detecting JSOn in string columns

- Delta Lake/Databricks: added filtering of extraneous Scala metadata when reverse-engineering bloom filters

- Snowflake: added reverse-engineering of stages and external tables

 

New features in v6.4.1 [19-Aug-2022]

- Apple Silicon ARM64: added application build optimized for M1 and M2 processors and achieve unprecedented performance

- Read-Only Viewer: added edition to allow navigation through models for consultation purposes only -- no creation or editing, no forward-engineering (except JSON Schema and Excel) or reverse-engineering.  When connected to Git repositories, also allows pull operations and commenting on change requests.  Request pricing at sales@hackolade.com

- Polyglot: adjusted behavior so external references in polyglot are derived into target physical models as direct external references, instead of transitive via polyglot model

- References: added handling if a parent object, being converted to a reference, contains a child attribute itself with a prior reference

- References: added detection of technical name collision when renaming references after copy/paste

- Workgroup: added ability to detect and visually resolve conflicts affecting change requests when the source branch becomes out-of-sync with the target branch

- Workgroup: added handling of multiple worktrees by filtering out their branches

- Workgroup: merged screens for Explore Models and Explore All Files, plus enhanced aesthetics 

- Workgroup: enhanced UX for local-only repositories

- Workgroup: enhance logging to reduce file size and redundancies, enhanced logging with git provider API call details 

- Avro: enhanced handling of enum symbols when deriving from polyglot

- BigQuery: added handling of typeMode=required in documentation

- Collibra: added publishing and reverse-engineering of foreign master relationships in denormalized models

- Delta Lake/Databricks: throttled fetching databases to accommodate API rate limiting

- Delta Lake/Databricks: added support for table options reverse-engineered from HQL files

- DynamoDB: added default JSON data for data types binary and binarySet

- DynamoDB: added Faker function-based (bulk) sample generation in script tab to apply to instance

- YAML: added possibility to choose quoting style (unquoted, single-quote, double-quotes) in preview and forward-engineering, including new argument quotingType in CLI forwEng command

 

New features in v6.4.0 [12-Aug-2022]

- Tech refresh of Electron (v19.0.10), NodeJS (v16.14.2), Chromium (v102.0.5005.167), V8 (v10.2) and Electron-related modules.  Includes backported fix for CVE-2022-2162 vulnerability

- WARNING: support for Windows 7 is discontinued with this version

- Workgroup Edition: improved error handling dialog when user has limited or no access to repository

- Workgroup Edition: harmonized access to Repository options and hub connections

- Cassandra/ScyllaDB: as ALTER TYPE syntax has been deprecated starting with Cassandra 3.10 and DataStax 5.0.6, replaced with DROP + CREATE column statements in ALTER script of delta model, plus added display of warning badge for incompatible data type change in Compare & Merge dialog

- MongoDB reverse-engineering: added timeout in probabilistic schema inference process plus enhanced logging

- YAML forward-engineering: added double-quote encoding of strings when necessary (semicolons, hash signs, and unicode characters)

 

New features in v6.3.1 [05-Aug-2022]

- Detection of outside changes in open model: added handling of models stored and synched on OneDrive

- Collibra: added handling of relationships when when parent and/or child are in nested objects

- Compare and merge: enhanced handling when one model has technical names and the other doesn't

- Compare and merge: enhanced named-based detection to better detect names when differences are minor (underscores between words instead of spaces, etc.)

- Custom properties: added migration of data models when changing a property from propertyType="select" to propertyType="multipleCheckboxSelect"

- Workgroup: use commit short hash in model name when opening model from commit history view

- Workgroup: preserve state and select row of history view when changing context then returning to repository context

- Workgroup: added auto-refresh of history view when creating or deleting a branch

- Workgroup: added auto-refresh of history view when discarding local changes from uncommitted row

- Workgroup: enhanced up and down arrow key navigation in history view to go to previous/next page when available

- Workgroup: enhanced GitHub OAuth user experience to clarify steps

 

New features in v6.3.0 [29-Jul-2022]

- Infer Primary Keys and Foreign Key relationships: for RDBMS targets and related, new feature to automatically help identify candidate PKs and FKs in a model, if not yet explicitly reverse-engineered or declared, based on machine learning and probabilities.  Available in BigQuery, Delta Lake/Databricks, Hive, MariaDB, Oracle, PostgreSQL, Redshift, SQL Server, Snowflake, and Synapse plugins.

- Compare and Merge: refactored dialogs to allows for all permutations of the Workgroup Edition's screens for review changes, merge conflict, and comparisons between different commits

- Custom properties: added tolerance for presence of unrelated json files (or backups) in properties_pane/<level> directories

- Tools > Options > General: added possibility to backup and restore user parameters and connection settings.  Useful also when moving to another machine

- Workgroup Edition: added repository history screen, including filters by data model, branch, or author

- BigQuery: added primary key property for documentation purposes only

- MongoDB: added possibility to reverse-engineer fields declared in validator script but no data type is defined

- MongoDB: added default creation of _id field when not present in validator script and collection is empty

- OpenAPI: adjusted validations of text inputs in block inputs

- Swagger/OpenAPI: added default opening of components if no resources are reverse-engineered

 

New features in v6.2.5 [23-Jul-2022]

- Excel:enhanced validation when exporting graph models

- Model API generation: added help link next to template selection, plus enhanced error message when selected file is not a template

- Polyglot: added spinner when large model is being derived

- Polyglot: enhanced handling when replacing a reference to a definition by its attributes

- Workgroup: reload data model if changes detected after pull operation

- Workgroup: leverage GitHub GraphQL API to populate list of Pull Requests screen

- Workgroup: enhanced conflict resolution after merge of local branches

- Parquet: fixed issue causing 'Too many files opened" message

 

New features in v6.2.4 [17-Jul-2022]

- Command-Line Interface: reordered commands

- Multiple data types: enhanced removal when complex data type is last one left

- Polyglot: added possibility to give a name to the polyglot link.  Can be helpful when making multiple links to the same polyglot model, for different profiles

- ArangoDB: allowed custom properties in relationships

- Avro: enhanced schema validation messages

- JanusGraph: allowed custom properties in relationships

- Oracle: enhanced parsing of view SELECT statement

- Snowflake: enhanced reverse-engineering when data sampling enabled

 

New features in v6.2.3 [08-Jul-2022]

- Command-Line Interface: added commands to export and import with Excel from the CLI

- Polyglot: allowed deviations in attribute business and technical names in target model when deriving from Polyglot

- Polyglot: adjusted mapping of binary type when reverse-engineering XSD

- Workgroup: added possibility to link Change Request to assignees from the Submit for review screen

- Workgroup: added possibility to link GitHub Pull Request to reviewers from the Submit for review and the Check pR screens

- Cosmos DB with MongoDB API: added possibility to generate synthetic/mock/fake documents and applied in bulk to the instance

- DocumentDB: added possibility to generate synthetic/mock/fake documents and applied in bulk to the instance

- Couchbase: added possibility to generate synthetic/mock/fake documents and applied in bulk to the instance

- Oracle: added tolerance for GET_DDL returning concatenated statements without delimiter

- Oracle: added SQL terminator to view DDL retrieval

- PostgreSQL: changed escaping from $ to C-style

- SQL Server: adjusted mapping of data types when deriving from Polyglot to convert string sizes greater than 8000 to (n)varchar(MAX)

 

New features in v6.2.2 [04-Jul-2022]

- JSON Schema: added possibility to declare multiple data types including at least one complex data type without oneOf choice

- Excel import: added support for relationships on nested attributes

- Excel import: added support for cross-target references

- Polyglot: allowed modification of business and technical names for attributes and UDTs/model references

- Polyglot: added handling of references when multiple derivations from the same polyglot model

- Workgroup: added auto reuse of provider credentials for Git authentication

- Workgroup: added GitHub OAuth device flow method

- Workgroup: added possibility to assign a Pull Request by picking from a list of possible assignable users

- Workgroup: added handling for Pull Request comments deleted on web console

- Oracle: added tolerance for GET_DDL returning concatenated statements without delimiter

- SQL Server: added support for MATCH, ON UPDATE, and ON DELETE for FK relationships

- SQL Server: allowed use of named instance in connection host parameter

 

New features in v6.2.1 [24-Jun-2022]

- Azure Blob Storage and Azure Data Lake Storage (for JSON, Parquet, Avro...): collapsed hierarchical folders so they only get discovered when node is expanded

- Azure Blob Storage and Azure Data Lake Storage (for JSON, Parquet, Avro...): increased limit of discovered objects to 1000

- JSON data sample for pattern fields: generate default name by regular expression

- JSON data sample for fields with data type "any": added handling using sub-object if exists or string

- JSON Schema: allowed root to be an array (in addition to historic possibility for root to be a document)

- Polyglot: fixed inconsistency when deriving model definitions/UDTs into a target model

- Test data generation: upgraded to FakerJS v7.3.0 library

- Workgroup: adjusted finding consistent source branch during resolution of conflicts during discard

- Workgroup: prevented lock during background check for remote commits

- Workgroup: enhanced UX and handling of token expiration state

- Workgroup: enabled caching for some GitHub API requests

- Workgroup: enhanced GitHub credentials setup to favor personal tokens, as passwords are now deprecated

- Workgroup: disabled forbidden actions for users with GitHub read-only tokens

- Workgroup: added column for authors in lists of change requests

- Workgroup: added submit and review actions to Repository menu

- Workgroup: added timestamp tooltip to all screens with relative dates

- Workgroup: added handling of blocked Pull Requests

- Hive: adjusted forward-engineering "apply to instance" script with deactivated objects

- MariaDB: adjusted conversion of sample and default properties when deriving from Polyglot Boolean into tinyint(1)

- Parquet: enabled primary key property for documentation purposes only

- PostgreSQL: adjusted mapping when deriving nvarchar from Polyglot to varchar

- PostgreSQL: added support for MATCH, ON UPDATE, and ON DELETE for FK relationships

- SQL Server: adjusted conversion of sample and default properties when deriving from Polyglot Boolean into bit

- SQL Server: adjusted mapping when deriving timestamp from Polyglot to Datetime2

- Synapse: adjusted conversion of sample and default properties when deriving from Polyglot Boolean into bit

- Synapse: adjusted mapping when deriving timestamp from Polyglot to Datetime2

- Synapse: added possibility apply DDL to instance

 

New features in v6.2.0 [17-Jun-2022]

- Workgroup: added support for GitHub (.com as well as Enterprise Server) for workflow to submit and review Pull Requests

- Workgroup: added possibility to authenticate on GitHub using personal token

- MongoDB synthetic data generation: added progress bar when generating in bulk

- Documentation generation: added support for recursive references

- Excel import: added support of string formats

- JSON Schema: added possibility to generate JSON Schema when subschema of choice inside a data type "any" is scalar

- Polyglot: fixed selection of multiple keys when they are references to model definitions/UDTs

- Polyglot: fixed rendering of group input properties when referencing definitions

- Azure Data Lake Storage (for JSON, Parquet, Avro...): enhanced discovery nested sub-folders when empty 

- Azure Data Lake Storage: added Advanced tab in Connection Settings for Prefix selection

- Hive: enhanced apply to instance with commented drop statement

- PostgreSQL: added validation of primary/unique keys, plus added warnings in forward-engineering script when primary/unique constraints have no keys

- Redshift: enhanced fetching of tables/views if schema has more than 500 of entities

 

New features in v6.1.3 [10-Jun-2022]

- Network proxy: increased logging and error details

- Polyglot: added enforcement that only a single column can be a primary key, or it should be part of of a compound key

- Polyglot: added possibility to edit required property in UDTs

- Polyglot: fixed resolution of references before normalization when applicable

- XSD: added translation of mxOccurs=1 into required/not null during reverse-engineering

- Workgroup: added Git status icons to repository explorer tables

- Workgroup: disabled Pull button when there is no remote tracking branch

- Avro: forward-engineer Confluent subject name from schemaGroupName property

- Hive: added the possibility to apply forward-engineering HQL script to instance

- Hive: adjusted v2 HQL script to filter out v3-specific features

- MongoDB synthetic data generation: added possibility to specify the number of mock/fake documents to be created and applied to the instance

- Parquet on Azure Data Lake Storage: enhanced discovery when many non-parquet files are also present

- Protobuf: updated protobufjs libraries

 

New features in v6.1.2 [03-Jun-2022]

- Redrew toolbar and contextual menu icons with SVG for cleaner hi-res displays

- Workgroup: added possibility to end or continue merge branch process

- Polyglot: adjusted warning for UUID enums, sample, and examples properties

- Added "Apply to instance" button for all remaining RDBMS and SQL-like targets: Databricks, Hive, MariaDB, Oracle, PostgreSQL, Redshift, Snowflake, SQL Server, Synapse

- OpenAPI/Swagger models derived from Polyglot: added ability to edit properties of references

- RDBBMS and SQL-like targets: added enforcement that only a single column can be a primary key, or it should be part of of a compound key

- Hive: enhanced handling of constraints rely/no rely, disable novalidate

 

New features in v6.1.1 [27-May-2022]

- ERD: added display option in toolbar and Tools > Options > Display to show/hide attribute data types

- Application log files: enhanced so logs are no longer reset with start of additional application instances -- only when first instance gets started

- Test data generation: added possibility to specify the number of documents to generate in Tools > Forward-Engineer > JSON documents

- Test data generation: added Faker function-based sample generation in script tab to apply to instance of concerned targets (MongoDB, Couchbase, Cosmos DB, DocumentDB, JanusGraph, Neo4j, Neptune, TinkerGraph)

- Test data generation: upgraded to FakerJS v7 library

- Workgroup: added action to merge branches

- Couchbase: added ability to reverse-engineer buckets with no N1QL primary index, by automatically falling back to REST API for sampling and schema inference

 

New features in v6.1.0 [20-May-2022]

- Generate fake but realistic data for development, testing or demos.  More info at https://hackolade.com/help/Generatemockdatafortesting.html

- Compare and Merge: added auto-selection of matching method when comparing models with different GUIDs

- Compare and Merge: added display option to only show conflicts

- Reference definitions: added support in RDBMS targets for definitions containing polymorphic choices

- License key validation: enabled Tools > Options so the network proxy settings can be adjusted

- Workgroup: added auto-discovery of git.exe on Windows in likely places if not specified in system PATH

- Workgroup: added app version, system info, git version at the top of the git log

- Workgroup: minimized chatty git logging when auto-checking for remote commits

- Workgroup: disallowed Review Changes in Push screen if remote branch does not exist

- Cassandra: added generation of WHERE clause with IS NOT NULL for partition keys, clustering keys, and other selected columns in materialized views

- MariaDB: added forward-engineering of table comments

- MongoDB: added possibility to apply to instance Field-Level Encryption parameters in createCollection scripts

- MongoDB: added detection of Field-Level Encryption during reverse-engineering

- Oracle: added support for reverse-engineering of identity column

- Snowflake: added support of identity column in properties and forward-engineering of DDL

- Synapse: added support for forward- and reverse-engineering of partition keys

 

New features in v6.0.8 [13-May-2022]

- References to external definitions: fixed display of relative path

- Polyglot: added creation of many-to-many join table when normalizing on-the-fly to an RDBMS target during deriving from denormalized polyglot model

- Workgroup: added Tools > Options Repository check for adequate Git executable when specifying a custom path

- Workgroup: fixed refresh of model list when checking out a new branch

- Avro: added min/max length properties for string data type, for documentation purposes only

- Avro: added support for reverse-engineering of schemas with empty records

- Delta Lake/Databricks: added fallback for getting view names and improve logging

- Delta Lake/Databricks: added handling for syntax of USING, BLOOMFILTER, TBLPROPERTIES, and PARTITIONED BY when reverse-engineering from HQL file

- Delta Lake/Databricks:  added support for forward- and reverse-engineering of DISABLE NOVALIDATE

- Hive:  added support for forward- and reverse-engineering of DISABLE NOVALIDATE

- MongoDB version 5 and higher: added support for Time-Series collections

- OpenAPI and EventBridge Schema Registry: added support for media type including dots

- Redshift: added support for forward- and reverse-engineering of schema, table, and column comments

- Synapse: added support for partitioning

 

New features in v6.0.7 [06-May-2022]

- Added handling of circular external references in JSON Schema 

- Added warning when enumerations are not unique

- Compare & Merge: added dialog asking user to handle unsaved changes

- Compare & Merge: moved button to generate delta model to the Compare panel

- Introduced a Read-Only mode for delta models (and future use in model history view of Workgroup Edition)

- Workgroup Edition: disabled auto-loading of last repository when using the Command-Line Interface

- Delta Lake: fixed issue when Partition Key was a reference to a definition/UDT

- MongoDB: re-enabled relationship properties for binary data type

- Oracle: added generation of constraint names in DDL for composite primary and unique keys

- Oracle: added support for identity start and increment

 

New features in v6.0.6 [29-Apr-2022]

- Excel export/import: added handling of font size and colors for entities and views

- Excel export: added to the relationships tab the names of parent & child entities and attributes to illustrate GUIDs

- External references: added a warning when user attempts to self-reference the model, given the risks of circular references

- License validation: added version number to UserData1

- Polyglot: enabled composite Primary Keys and Unique Keys

- Workgroup: added author and date of last commit to Explore > Models and All Files table

- Azure Blob Storage and Azure Data Lake Storage for JSON and Avro: added 3 authentication methods: Anonymous, Shared Access Signature, and Shared Access Token per container

- Delta Lake: removed unused modules async and thrift from plugin

- Synapse forward-engineering of ALTER scripts from delta model: added a flag to explicitly un-comment DROP statements, signifying the understanding of the possible consequences

 

New features in v6.0.5 [22-Apr-2022]

- Improved application startup performance with streamlined license validation process on Windows

- Custom properties: added handling of property names collision with reserved JSON Schema keywords

- JSON Schema Preview: added resolution of references in choices

- Tools > Options: added preservation of changes when changing tabs until applied or exist with OK

- Polyglot: added composite Foreign Key relationships

- Workgroup: added Review Changes capability to Commit, Pull, and Push screens

- Workgroup: added display of Git badges on Welcome Page if recent files or recent folders are git-enabled

- Workgroup: updated simple-git library to latest version 3.6.0

- Cosmos DB Gremlin: added validation of endpoint in connection settings

- Delta Lake/Databricks: added reverse-engineering of database location

- Delta Lake/Databricks: added forward-engineering of reference descriptions in column comments

- ScyllaDB: caught up with latest Cassandra plugin developments

 

New features in v6.0.4 [18-Apr-2022]

- Tech refresh of Electron (v17.4.0), NodeJS (v16.13.0), Chromium (v98.0.4757.141), and Electron-related modules.  Addresses Chromium V8 CVE-2022-1096 vulnerability

- ERD: added shortcut Ctrl+Shift+T (Cmd+Shift+T on Mac) to open the selected entity(ies) in a new tab 

- Compare & Merge: improved visibility of display options

- Excel options: moved loading of parameters from application start to forward- and reverse-engineering actions

- Polyglot: made it more obvious that deriving a target model must be done by first creating a target model from which the pulling action must be performed

- Polyglot: added possibility to derive a polyglot model from another polyglot model

- References: added possibility for entities to reference model and external definitions

- Cassandra: adjusted sequence of ALTER statements from delta model to RELOAD SEARCH INDEX after DROP

- Hive forward-engineering of ALTER scripts from delta model: added a flag to explicitly un-comment DROP statements, signifying the understanding of the possible consequences

- Neo4j: updated plugin to latest driver version 4.4.5

- Redshift forward-engineering of ALTER scripts from delta model: added a flag to explicitly un-comment DROP statements, signifying the understanding of the possible consequences

 

New features in v6.0.3 [08-Apr-2022]

- Added shortcuts to move between contexts (Data Modeling, Repository, etc...- as well as in View menu

- Compare & Merge: added display option to filter negligible properties (descriptions, comments, samples, defaults)

- DDL reverse-engineering: added handling of not-encoded special characters in comments

- Plugin Manager: added logging for steps plugin installation for better troubleshooting

- Workgroup: added list of recent repositories in Welcome screen

- Workgroup: added auto-detect of remote commits

- Workgroup: added Discard action in commit local changes pane

- Workgroup: added support for multiple selection in commit local changes pane

- Workgroup: ensured auto-commit of pulled changes if default changed in Git global config

- Workgroup: added binding of Enter key to primary action in Repository Context

- Workgroup: added conflict resolution on repos without remote

- Workgroup: enhanced Git error dialog to allow copy/paste of message and opening of log file

- Workgroup: added message when push/pull actions are attempted while offline

- BigQuery: updated library for parsing views

- Cassandra: added property and CQL script for search index column option {lowercase: true}  

- Cassandra: adjusted alter index search and alter column statements logic

- Databricks: added support for Runtime v10

- Delta Lake/Databricks: replaced Scala commands in forward- and reverse-engineering by Python commands, to allow more flexible security settings

- Delta Lake forward-engineering of ALTER scripts from delta model: added a flag to explicitly un-comment DROP statements, signifying the understanding of the possible consequences

- MarkLogic: updated SDK driver version

- MongoDB Field-Level Encryption: added rule to linter so as to identify cases when encryptMetadata keyId is missing in parent

- Protobuf: added reverse-engineering of top-level messages as separate entities created from model definitions when "separate schemas" option is chosen

- Snowflake: added inference of case-sensitive object names in reverse-engineering of file and instance

 

New features in v6.0.2 [04-Apr-2022]

- BigQuery forward-engineering of ALTER scripts from delta model: added a flag to explicitly un-comment DROP statements, signifying the understanding of the possible consequences

 

New features in v6.0.1 [01-Apr-2022]

- Workgroup: added auto-resolution of Git conflicts affecting data model metadata

 

New features in v6.0.0 [31-Mar-2022]

- [Optional] Workgroup Edition: for teams to collaborate on data models, with versioning, branching, peer reviews, and DevOps integration through Git repositories.  More info at https://hackolade.com/help/Repository.html  Requires the purchase of an upgrade license key from Professional to Workgroup.

- Stopped including .chm user documentation in Windows installer -- up-to-date user doc online at https://hackolade.com/help