CloudConnect is tool for data transformation, integration and the complete ETL process. All the processes are deployed and maintained on our servers. The key components are the CloudConnect Designer and the CloudConnect LDM Modeler. This is the best way to load your data into the GoodData platform. You are able to create a data model, extract, transform and load your data into the Platform.
Here you can first CloudConnect project. Download complete package.
There is a canvas in the center of CloudConnect Designer where you can work on your data loading process.
1) The Graph Editor with the Palette of Components is in the upper right part of the window.
In this panel, you can create your graphs. The Palette of Components allow you to select components, move them into the Graph Editor, connect them by edges. This panel has two tabs.
2) Navigator & Server Explorer panel is in the upper left part of the window.
There are folders and files of your projects in the Navigator tab. You can expand or collapse them and open any graph by double-clicking the item.
The Server Explorer tab contains the hierarchical list of all GoodData platform projects and deployed ETL graphs.
3) The Outline panel is in the lower left part of the window.
There are all of the parts of the graph that are opened in the Graph Editor.
4) Tabs panel is in the lower right part of the window.
You can see the data parsing process in these tabs.
CloudConnect Project consists of two main parts. The first is ETL process and second is LDM model. In LDM model you define the logical data model in GoodData Project. In ETL process, you define all steps to transform the data so that it will fit the model. In the next part, you’ll learn how to create new CloudConnect Project.
Let’s try it
First of all just before creating a new CloudConnect Project, lets sign in with your GoodData account. Select Server -> Sign In from the application Menu
Fill in your GoodData credentials and click Sign In. Now you can easily create a new CloudConnect Project by following steps below:
1) Go to the File menu and select New
2) Select CloudConnect Project from the sub menu
3) Name your project and choose GoodData project
As you can see in the picture above, you are able to pick one of your existing projects or create new, empty project. You will need an authorization token to create new project. Read more about tokens in the article. If you don’t have your authorization token, you can register to CloudConnect evaluation program here, the link is also available from the CloudConnect directly as you can see below.
- GoodData Developers Evaluation Program Request token
If you already have your production authorization token, feel free to use it.
4) Finally, press “Finish”
Now, the new CloudConnect project is created and you can see its structure in the left box.
There are several folders inside the Project. Let’s describe them little bit more:
data - folder for storing incoming (source) and outgoing (gooddata) data. There is also tmp and transform folders for storing data during transformation and for temporary usage.
graph - folder for storing your graphs
meta - for storing shared metadata across the multiple graphs
model - the GoodData logical data model is stored here. You can create it using the LDM Modeler component
trans - for storing scripts that you want to use in multiple graphs
There is also workspace.prm that includes all parameters that can be mapped and used within the data loading process. In the next article you will learn how to create data model using LDM Modeler. Make sure you have the latest CloudConnect version. Read more in the article.