Skip to content

Section 1 - Create a CUSTOMER schema, by sourcing an excel spreadsheet from GIT via the Apiro UI

Go back to Getting started guide

In this section we will:

Walk through

Sourcing an Excel file from GIT using the Apiro UI (5 minutes)
  1. Run the compose script discussed in the installation guide eg.
    1
        ./runapiro.sh v1 apiroexamples-copy-pub clean
    
  2. Go to http://127.0.0.1:8080/ and login using admin and the password you specified in apiro-apiroexamples-copy-pub-properties.env
    raw login_page
  3. Click on Configuration -> Schema/Feeds
    schema_config_menu_item
  4. Click on New Schema
    new_schema
  5. Click on the Data Source drop down
    data_source_type_selection
  6. Select GIT Data source
    select_git_data_source
  7. Copy and use these data source configuration shown below

    • and click on Test Connection.
    • Enter data as the value for discriminator.
    • You can use the data sources configuration shown below, but you can also overwrite
      "gitURL": "https://github.com/redapiro/apiro_examples.git" with your own repository you created and as described in the installation instructions.

      1
      2
      3
      4
      5
      6
      7
          {
                  "username": "${SYS:APIRO_GITHUB_USERNAME}",
                  "password": "${SYS:APIRO_GITHUB_PW}",
                  "gitURL": "https://github.com/redapiro/apiro_examples.git",
                  "branch": "main",
                  "pathPrefix": "/artifacts/source_files/customers_a.xlsx"
          }
      

    data_discriminator.png

  8. Once you establish a successful connection Next successful_connection

  9. If the file is a CSV or Excel we need to select the row that contains the column names and the first row the data starts. select_header_data_lines

  10. Once you click on the relevant lines the Title line and the Data line will be populated and we can click Next. select_header_data_lines

  11. The platform automatically creates data point descriptions, display names, derives the data types and maps them to excel column positions or CSV column names. data_mapping_page

  12. For each data point descriptor we can click on the three dots (...) to provide more information and metadata. 3dots
  13. we can specify retention policies, PII classification and validators for each data point. data_classifications

  14. Click Done for each data description page and then Next data descriptor mapping page. data_mapping_over15chars

  15. Then we can specify the Group EXAMPLES for this schema and metadata. Specifying these can facilitating cataloging and data governance. We will see below that, Group is used to group the schemas in the UI. In this case under the Group EXAMPLES. Please use the values used in the screenshots provided below. schema_group_metadata_page schema_group_metadata_specified_page

  16. On the next page we specify details about the schema and the feed. Make the following changes as shown in the screenshot:

    • Rename the schema name from CUSTOMERS_A to CUSTOMERS.
    • Leave the Feed name as is: CUSTOMERS_A_XLSX.
    • Rename the Feed directory from DEFAULT to customers. Note: The Feed Directory refers to the subdirectory the generated feed configuration file will be pushed into. eg. https://github.com/redapiro/apiro_examples/dataFeeds/customers.
      • Cron Trigger
        1
            0 0 18 ? * * * 
        

      add the following cron trigger and description.

      • Description
        1
            Every day at 6pm (18:00)
        

    feed_cron_empty feed_cron_specified

  17. We click Next and we can see the generated SCHEMA configuration file schema_config

  18. We click Next and we can see the generated FEED configuration file feed_config
  19. We click Next on the feed configuration page and both generated configuration files will be pushed to GIT and deplyed to the Apiro engine. success_push
  20. We have just completed data integration with a source, created data descriptors, metadata and data pipelines and we are ready to start sourcing. We click on Data Manager and we can see the newly generated Group and CUSTOMER Schema data_manager_new_group
  21. We click on Actions -> Feeds Import. feed_import
  22. We select the feed CUSTOMERS_A_XLSX we just created. trigger_feed
  23. Once we trigger the feed we can see the data start sourcing and we can see the RAW, CONSOLIDATED and HISTORICAL data tables. If you don't see any data you may have to click on the red refresh button at the bottom right of the page. imported_data

Generated configuration files

The files below are the ones generated following the steps provided above.

Generated config files for schema and feed

Generated schema config

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
        <?xml version="1.0" encoding="UTF-8"?>

        <apiroConf version="1">
            <groups/>
            <loadOrder>15</loadOrder>
            <schemas>
                <schema defBacked="false" historical="false" name="CUSTOMER">
                    <groupTags>
                        <groupTag>EXAMPLES</groupTag>
                    </groupTags>
                    <metaData/>
                    <abstract>false</abstract>
                    <workingRetention>100 years</workingRetention>
                    <historicalRetention>100 years</historicalRetention>
                    <allowHistoricalUpdate>false</allowHistoricalUpdate>
                    <biTemporal>false</biTemporal>
                    <temporalTimeFormat>yyyy-MM-dd</temporalTimeFormat>
                    <identityKeys>
                        <identityKey>BAC</identityKey>
                    </identityKeys>
                    <shardKeys/>
                    <dataPoints>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="BAC" name="BAC">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>false</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="FIRST_NAME"
                                   name="FIRST_NAME">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="LAST_NAME"
                                   name="LAST_NAME">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="ADDRESS"
                                   name="ADDRESS">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="PHONE_NUBER"
                                   name="PHONE_NUBER">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="INTEGER" displayName="AGE" name="AGE">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="INTEGER" displayName="YEARLY_INCOME"
                                   name="YEARLY_INCOME">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="TFN" name="TFN">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="INTEGER" displayName="PORTFOLIO_VALUE"
                                   name="PORTFOLIO_VALUE">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="COMPANY_NAME"
                                   name="COMPANY_NAME">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="COMPANY_ADDRESS"
                                   name="COMPANY_ADDRESS">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="COMPANY_WEBSITE"
                                   name="COMPANY_WEBSITE">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                        <dataPoint canEditValid="false" canEditViolated="true" dataType="STRING" displayName="PROFILE_IMAGE"
                                   name="PROFILE_IMAGE">
                            <groupTags>
                                <groupTag>DEFAULT</groupTag>
                            </groupTags>
                            <metaData>
                                <item name="piiClassification">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                                <item name="retentionPolicy">
                                    <simpleValues>
                                        <simpleValue>NA</simpleValue>
                                    </simpleValues>
                                </item>
                            </metaData>
                            <nullable>true</nullable>
                            <noOverride>false</noOverride>
                            <rawDPValidators/>
                            <rawDPProcessors/>
                            <consDPValidators/>
                            <consDPProcessors/>
                            <pii>false</pii>
                            <encrypted>false</encrypted>
                            <encryptionKeyId>DEFAULT</encryptionKeyId>
                            <ignoreChangeDetect>false</ignoreChangeDetect>
                        </dataPoint>
                    </dataPoints>
                    <schemaAppliedProcessors>
                        <groupTags>
                            <groupTag>DEFAULT</groupTag>
                        </groupTags>
                        <metaData/>
                        <rawDPValidators/>
                        <rawDPProcessors/>
                        <consDPValidators/>
                        <consDPProcessors/>
                        <dataBlockProcessors/>
                    </schemaAppliedProcessors>
                    <alerts/>
                </schema>
            </schemas>
        </apiroConf>

The above schema configuration file will be generated when you complete all the above steps. It placeholders for metadata and data governance features. For the purpose of this Getting Guide we are removing all elements that are not required to complete the Getting Started. You can copy the configuration provided below and override the contents of 'SCHEMA_CUSTOMER.xml'

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
    <?xml version="1.0" encoding="UTF-8"?>

    <apiroConf version="1" xmlns="http://apiro.com/apiro/v1/root">
        <groups/>
        <loadOrder>15</loadOrder>
        <schemas>
            <schema defBacked="false" historical="false" name="CUSTOMERS">
                <groupTags>
                    <groupTag>EXAMPLES</groupTag>
                </groupTags>
                <metaData/>
                <identityKeys>
                    <identityKey>BAC</identityKey>
                </identityKeys>

                <!-- Data Point descriptions -->
                <dataPoints>
                    <dataPoint name="BAC"
                               dataType="STRING"
                               canEditValid="true"
                               canEditViolated="true"
                               displayName="BAC">
                        <nullable>false</nullable>

                        <metaData>
                            <item name="piiClassification">
                                <simpleValues>
                                    <simpleValue>High-Risk</simpleValue>
                                </simpleValues>
                            </item>
                        </metaData>

                        <!-- BAC data point processors -->
                        <rawDPValidators/>
                        <rawDPProcessors/>
                        <!--consolidationAlgorithm></consolidationAlgorithm -->
                        <consDPValidators/>
                        <consDPProcessors/>
                    </dataPoint>

                    <dataPoint name="FIRST_NAME" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="FIRST NAME"/>
                    <dataPoint name="LAST_NAME" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="LAST NAME"/>
                    <dataPoint name="ADDRESS" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="ADDRESS"/>
                    <dataPoint name="PHONE_NUMBER" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="PHONE NUMBER"/>
                    <dataPoint name="AGE" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="PHONE AGE"/>
                    <dataPoint name="YEARLY_INCOME" canEditValid="false" canEditViolated="true" dataType="DECIMAL" displayName="YEARLY INCOME"/>
                    <dataPoint name="TFN" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="TFN"/>
                    <dataPoint name="PORTFOLIO_VALUE" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="PORTFOLIO VALUE"/>
                    <dataPoint name="COMPANY_NAME" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="COMPANY NAME"/>
                    <dataPoint name="COMPANY_ADDRESS" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="COMPANY ADDRESS"/>
                    <dataPoint name="PROFILE_IMAGE" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="PROFILE_IMAGE"/>
                    <dataPoint name="COMPANY_ADDRESS" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="COMPANY ADDRESS"/>
                    <dataPoint name="COMPANY_WEBSITE" canEditValid="false" canEditViolated="true" dataType="STRING" displayName="COMPANY WEBSITE"/>
                    <dataPoint name="XML_ROOT_DOC"  canEditValid="false" canEditViolated="true"  displayName="XML Root Doc" dataType="XML"/>
                    <dataPoint name="JSON_ROOT_DOC"  canEditValid="false" canEditViolated="true"  displayName="JSON Root Doc" dataType="JSON"/>
                </dataPoints>
                <schemaAppliedProcessors>
                    <groupTags>
                        <groupTag>DEFAULT</groupTag>
                    </groupTags>
                    <metaData/>
                    <rawDPValidators/>
                    <rawDPProcessors/>
                    <consDPValidators/>
                    <consDPProcessors/>
                    <dataBlockProcessors/>
                </schemaAppliedProcessors>
                <alerts/>
            </schema>
        </schemas>
    </apiroConf>

Generated data feed config:

  1
  2
  3
  4
  5
  6
  7
  8
  9
 10
 11
 12
 13
 14
 15
 16
 17
 18
 19
 20
 21
 22
 23
 24
 25
 26
 27
 28
 29
 30
 31
 32
 33
 34
 35
 36
 37
 38
 39
 40
 41
 42
 43
 44
 45
 46
 47
 48
 49
 50
 51
 52
 53
 54
 55
 56
 57
 58
 59
 60
 61
 62
 63
 64
 65
 66
 67
 68
 69
 70
 71
 72
 73
 74
 75
 76
 77
 78
 79
 80
 81
 82
 83
 84
 85
 86
 87
 88
 89
 90
 91
 92
 93
 94
 95
 96
 97
 98
 99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
    <?xml version="1.0" encoding="UTF-8"?>

    <apiroConf version="1" xmlns="http://apiro.com/apiro/v1/root">
      <groups/>  
      <loadOrder>30</loadOrder>  
      <dataFeeds> 
        <dataFeed definition="EXPR_EXCEL_FEED2" name="CUSTOMERS_A_XLSX">

          <schema>CUSTOMERS</schema>
            <metaData>
                <item name="APR_FEED_AUTOLOAD">
                    <simpleValues>
                        <simpleValue>true</simpleValue>
                    </simpleValues>
                </item>
            </metaData>
          <cronTriggers> 
            <cronTrigger> 
              <description>Every day at 6pm (18:00)</description>  
              <cron>0 0 18 ? * * *</cron> 
            </cronTrigger> 
          </cronTriggers> 
          <groupTags> 
            <groupTag>DEFAULT</groupTag> 
          </groupTags>  
          <metaData/>  
          <abstract>false</abstract>  
          <inheritable>true</inheritable>  
          <description/>  
          <execPriority>50</execPriority>  
          <execPredicate>#GRV{true}</execPredicate>  
            <config>
                <![CDATA[{
                    "dataSource": {
                      "config": {
                        "username": "${SYS:APIRO_GITHUB_USERNAME}",
                        "password": "${SYS:APIRO_GITHUB_PW}",
                        "gitURL": "https://github.com/redapiro/apiro_examples.git",
                        "branch": "main",
                        "pathPrefix": "/artifacts/source_files/customers_a.xlsx"
                      },
                      "entity": "GIT"
                    },
                    "dataAtLine": 2,
                    "sheet": "data",
                    "itemLimit": 20,
                    "explicitMappings": [
                      {
                        "dictionary": "BAC",
                        "value": "#GRV{PAYLOAD.resolve('A')}"
                      },
                      {
                        "dictionary": "FIRST_NAME",
                        "value": "#GRV{PAYLOAD.resolve('B')}"
                      },
                      {
                        "dictionary": "LAST_NAME",
                        "value": "#GRV{PAYLOAD.resolve('C')}"
                      },
                      {
                        "dictionary": "ADDRESS",
                        "value": "#GRV{PAYLOAD.resolve('D')}"
                      },
                      {
                        "dictionary": "PHONE_NUMBER",
                        "value": "#GRV{PAYLOAD.resolve('E')}"
                      },
                      {
                        "dictionary": "AGE",
                        "value": "#GRV{PAYLOAD.resolve('F')}"
                      },
                      {
                        "dictionary": "YEARLY_INCOME",
                        "value": "#GRV{PAYLOAD.resolve('G')}"
                      },
                      {
                        "dictionary": "TFN",
                        "value": "#GRV{PAYLOAD.resolve('H')}"
                      },
                      {
                        "dictionary": "PORTFOLIO_VALUE",
                        "value": "#GRV{PAYLOAD.resolve('I')}"
                      },
                      {
                        "dictionary": "COMPANY_NAME",
                        "value": "#GRV{PAYLOAD.resolve('J')}"
                      },
                      {
                        "dictionary": "COMPANY_ADDRESS",
                        "value": "#GRV{PAYLOAD.resolve('K')}"
                      },
                      {
                        "dictionary": "COMPANY_WEBSITE",
                        "value": "#GRV{PAYLOAD.resolve('L')}"
                      },
                      {
                        "dictionary": "PROFILE_IMAGE",
                        "value": "#GRV{PAYLOAD.resolve('M')}"
                      },
                      {
                        "dictionary": "XML_ROOT_DOC",
                        "value": "#GRV{PAYLOAD.resolve('N')}"
                      },
                      {
                        "dictionary": "JSON_ROOT_DOC",
                        "value": "#GRV{PAYLOAD.resolve('O')}"
                      }
                    ]
                  }
                ]]>
              </config>
          <longLived>true</longLived>  
          <enabled>false</enabled>  
          <push>true</push>  
          <pull>true</pull>  
        </dataFeed> 
      </dataFeeds>  
    </apiroConf>