340 likes | 351 Views
September 12-14, 2018 Raleigh, NC. Presenter: Robin Lamb – Director Client Services and Support. Datasources and Connecting to Your Data. Agenda. Connect to your data Unhide/hide mappings and fields Restrict fields Mapping Sets Mapping Suites Sharing Datasources
E N D
September 12-14, 2018 Raleigh, NC
Presenter: Robin Lamb – Director Client Services and Support Datasources and Connecting to Your Data
Agenda Connect to your data Unhide/hide mappings and fields Restrict fields Mapping Sets Mapping Suites Sharing Datasources Levels or permissions in sharing Create datasets(cleaning data) Share datasets with groups Linking datasets
Connect to Your Data Connect directly to a database Pull in a spreadsheet and create dataset Create a workspace and link tables within workspace to create dataset Link between database and workspace table or spreadsheet
Database Connection • Connect to most types of SQL databases • Connect to multiple schemas Set Connection Limit Set Database Timeout Test Connection before saving
Meta Data Depending on the type of database, properties will scan in as hidden or unhidden Run a full scan in to bring in all tables or choose Mappings Only and scan individual mappings Hide or unhide tables/fields to allow teams with permissions to create datasets Create links between database tables or create remote links between datasources
Hidden Tables and Fields To unhide a hidden field, choose fields and then actions.
Modifying Fields Informer allows you to add fields to your mappings. Custom fields are created using sql statements. You can modify the field inside the datasource
Joins/Links Types of Joins – Left, Inner, Outer Scalar Joins Remote Joins – create joins from one datasource to another Left Outer Join Scalar Join Remote Join
Field Pairings • Use operators for different types of joins • Add more than one pairing to create a complex join
Scalar Joins Add a condition to a join to create a subset of data via a link
Remote Joins Remote joins allow you to connect other datasources outside of existing one. The link shown here is a link from a database connection to a workspace datasource.
Create a Dataset from Remote Join Create a Dataset that pulls data from the database datasource and the workspace datasource.
Add Permissions On Your Datasource By… • Adding Mapping Sets to Your Datasource • Restricting Fields • Sharing Datasource with Teams • Giving Custom Access to Datasource • Giving Limited Access to Dataource
Creating Mapping Sets Mapping sets allows administrators to create groups of mappings so that users can only have permission to specific tables. • Highlight Mappings to add to a Mapping Set • Click on Actions in lower right corner • Choose Change Sets • Click Add Set or Choose Existing Set
Mapping Sets (Continued) Mapping Sets are identified in the list of Mappings by the Icon and color you choose when setting them up. Choose Set and Hit Apply
Set Restricted Fields Open the Field in the Mapping and check the Restricted box.
Mapping Suites Will be available in version 5.1 Create Mapping Suites for files where data is partitioned by date Example: Colleague File Suites SA.ACYR - Pointing to SA.2017, SA.2018, SA2019 Or you could create your own tables that hold specific groups of data and create a suite to run against or look at all groups together.
Mapping Suites Mapping Suites are attached to the individual Datasource To add a Mapping Suite, go to Datasource and click on Name the Suite and create the Partitions for each Mapping
Mapping Suites The partitions creates the group of data (ex. Year) The Mappings lets you choose the table that has the suite of data (ex. Orders_2019 or SA.2019)
Allows you to choose a default partition, prompt for partitions, choose all partitions, or select specific one. Creates the field based on what you name it in the setup
Sharing Datasources with Teams Once mappings are scanned, restricted fields set, mapping sets created then share datasource with Teams of users Giving access to teams will allow the Datasource to be queried. Governing data by security permissions – who has access to what data and what can they do with it
Sharing the Datasource No access to Datasource Limited Access – No access to restricted fields Full Access to Datasource - All Fields Custom Access to Datasource – Choose Mapping Sets Allowed and also whether or not the user has limited or full access to the Mapping Set
What is a Dataset • A Dataset is a set of indexed records • Records can come from multiple different types of sources • Query an existing datasource connection • Import or drag a .csv or .xlsx file into Informer 5 • Save an ad-hoc query as a dataset • Grab the streaming results of a REST call –using the Informer 5 API
Create Dataset and Share with Teams • Create a dataset via querying datasource, using a spreadsheet, or using a workspace • Share that dataset with a team
Create Dataset from Spreadsheet Drag spreadsheet into Informer 5 and create dataset or choose Upload a file Modify fields in field settings Clean data using data flows
Work Space What is work space? Provides the ability to upload multiple .csv files into Informer 5 and create tables in the Postgres database Link the new tables together to create a schema Create datasets from new tables Link table to other datasources
Creates a database within Informer with the ability to link between tables.
Governing Data • Only add fields you want the group of users to use to create visuals or dashboards • Clean data using data flows • Ex. Find and replace • Add data flow scripts to allow for other options on dashboards • Ex. Geo Location • Ex. Calculated Column
Sharing Datasources versus Datasets with Teams • Sharing a Datasource with a team allows the users on that team to have permissions to that datasource based on their roles • Sharing a datasource with a team also give the full access, limited access or custom access • Full Access- access to all mappings and fields • Limited Access- access to all mappings but no restricted fields • Custom Access-access to specific mapping sets - Custom access both Full and Limited access within the mapping sets • Sharing datasets to specific teams allows them to create visuals, pivot tables, and data views