Check out this article to set it up correctly: Generic Aggregation Best Practices
Or submit a ticket to support@captaindata.co to review your Custom Workflow.
Whenever you need to aggregate data and save such data, you'll need an independent task, a new step in your workflow.
To find the aggregation's step, you can search for the application Captain Data, and then "Generic Aggregation".
NOTE: Be sure to check the pre-made templates to see if there is an existing workflow that matches what you're trying to create. These templates come with the correct Aggregation Configuration, helping you avoid any mistakes.
How does it work?
In order to aggregate data, you'll need two previous steps:
-
FOR EACH - The first step you'll choose will be your index: for each first step's result, Captain Data will apply a filter to COMBINE data with the second step's results
CAUTION: We typically select the step closest to the Generic Aggregation. If you want to aggregate People and Companies, demand support to add the "Aggregate People & Companies" automation, which is only available in the templates.
-
COMBINE - As stated, this second step will enrich the first step's data
-
WHERE - Select the unique key data that will reliably match the records to ensure the steps are aggregated correctly.
--
Not recommended: - You can then ADD A FILTER: add an unlimited number of optional filters with the options "AND" and "OR" to control the aggregation's behavior ----
Note: that at the moment, if you select the "OR" filter, every other filters will have to be "OR".
TO KNOW
-
sales_navigator_profile_id
=linkedin_profile_id
-
BE CAREFUL:
linkedin_profile_id
can be different sometimes from an automation.- ACwAAABZLKUBwykYH7XGluYozbUU5BMdbcuXQ5Q
vs - 8859339
But if the data matches : Always prioritize thelinkedin_profile_id
over thesales_navigator_profile_id
if it is available.
- ACwAAABZLKUBwykYH7XGluYozbUU5BMdbcuXQ5Q
Always try to use an ID or Domain as the Company Name and URL can sometimes vary slightly between step results.
Tip: Launch a small batch and then check your results to compare the different fields to see which data could match.
USE CASES
- There are 2 Aggregations modules. The Generic Aggregation one, & the Aggregate People & Companies only available on some template due to his specific configuration.
-
The Generic Aggreg' can aggregate 2 steps using a key data that matches. ⚠️ But, it can be tricky to set up due to the way some step works (e.g: batches with the smart limit to keep your account safe creating duplicates, etc…)
- The Aggreg' People & Companies was created to ensure the right aggregation when there are people and company data. Sometimes, the linkedin_company_url is not accessible, so you can lose many leads with a simple Generic Aggreg'. This specific aggregation ensures the Company and People data are combined correctly, even if there is no company URL. As explained here: Discrepancies on the output from a step to another
So, if you don't mind losing those leads with inaccessible companies, then the Generic Aggregation is fine. Just make sure you place the For Each step right before the Generic Aggregation step to avoid any weird behavior & match a unique profile key data: Generic Aggregation Best Practices
-
The Generic Aggreg' can aggregate 2 steps using a key data that matches. ⚠️ But, it can be tricky to set up due to the way some step works (e.g: batches with the smart limit to keep your account safe creating duplicates, etc…)
I want to aggregate People & Company data:
- Search for a template that use the "Aggregate People & Companies" automation. If you cannot find your use case in the Store, > contact support.
I want to aggregate Company & Company data:
-
sales_navigator_profile_id
ORlinkedin_profile_id
-
domain
(not 100% accurate) -
company_name / company_url
(not 100% accurate)
I want to aggregate more People data to previous People data:
-
sales_navigator_profile_id
ORlinkedin_profile_id
I want to aggregate more company data on top of People & Company data:
-
sales_navigator_profile_id
ORlinkedin_profile_id
I want to aggregate more People data on top of People & Company data:
-
sales_navigator_profile_id
ORlinkedin_profile_id
I want to aggregate email data, content, post, to previous Generic Aggreg':
-
sales_navigator_profile_id
ORlinkedin_profile_id
If it sounds easy, try doing it manually, and you will see the complexity of finding the right key data to match between (People & Company Data + More People or Company Data). You will understand that:
-
- Sometimes two IDs from Sales Navigator and LinkedIn can be different.
- Two IDs from Sales Navigator can be different but redirect to the same profile.
- If you aggregate people data with a key that matches company data, the automation won’t know there are multiple profiles within the same company, which in some cases will aggregate the same profile to the same company. Because you're matching on company data, not profile data. And, to find this right profile data to match seems more complicated than that.