Indigo DQM Data Management Engine shared Data Sources can be used by all Data Command Queries in the System.
If the Data Source is common to multiple Data Queries then create a shared Data Source.
Select the Data Source Tab from the Indigo DQM Data Management Studio.
Indigo DQM supports multiple Data Sources and Types including Microsoft SQL Server, Microsoft Access, ODBC, OLEDB, MySQL, Oracle, Postgre, Firebird, XML, JSon and CSV. The Indigo DQM Data Management Engine is unique in its ability to handle multiple Data Sources and Types simultaneously making it transparent to virtually all Data Sources.
Create a Data Folder for the Data Source to organise it in the Data Store.
Creating a new Data Source
Enter a Name and Description for the Data Source and Select a Data Folder.
Data Source Files can be XML, JSon, CSV or TXT. These Data files can be local, files on a network or files located on the Internet / Intranet.
Connection Strings can be Saved or Opened into the Data Connection Dialog.
Advanced URI Properties
The URI properties of the Data Source allow the parameters to be defined for Host, User Name and Password if required.
Encrypted Data files can also be downloaded using HTTPS therefore securing Data transmission.
Enter the Host, Port and Path for the Data and the Security Credentials. If the Data is Encrypted with AES 256 Encryption then set the Encrypted Property to True.
The Advanced Encryption System (AES) uses a 256-bit encryption key. A secure Password must be setup in the Program Settings and Options or applied to an individual Data Asset Store. By default a global Encryption Password will be used but it is recommenced that you create your own unique Password.
Pulling Data down from the Internet / Cloud is a useful and powerful feature of Indigo DQM.
Creating a CSV Data Source
A comma-separated values (CSV) file stores tabular data (numbers and text) in plain text. Each line of the file is a data record and each record consists of one or more fields, separated by commas or another character used as the separator.
Specifying the location of the CSV Data Source which can be a local file or a file on the Internet.
The name "CSV" indicates the use of the comma to separate data fields. Nevertheless, the term "CSV" is widely used to refer a large family of formats, which differ in many ways. Some implementations allow or require single or double quotation marks around some or all fields; and some reserve the very first record as a header containing a list of field names.
CSV Data can use different characters as the separator and text qualifiers. These characters can be changed when setting up the Data Source to read CSV Data. Additional some CSV may or may not have the first line of text as the column header which represents the name of the field in the Data Table. All these options can be setup for the CSV Data Source thus ensuring complete compatibility with all CSV and Text Data Sources.
Data Security and Encryption
Data Source Files can be Encrypted and stored securely using military grade cryptography. The Advanced Encryption System (AES) uses a 256-bit encryption key. Encryption Passwords are used to create Strong Encryption Keys for the AES 256 System.
A secure Password must be setup in the Program Settings and Options or applied to an individual Data Asset Store. By default a global Encryption Password will be used but it is recommenced that you create your own unique Password.
Encryption Passwords must match when Encrypting / Decrypting Data. It is recommended that a copy of your Password be stored in a secure Location. If you lose this Password it will be impossible to Decrypt any Encrypted Data.
If the Data Source XML or CSV File is Encrypted ensure that the Encrypted property is set to True.