Gold Penguin Logo with Text

A Beginner’s Guide to Pulling Data from PhantomBuster Using Clay

Clay supports a lot of integrations, including PhantomBuster. Discover how you can harness this cool feature to pull and enrich your data effortlessly in this guide!
Updated November 16, 2023
pull data from PhantomBuster to Clay
pull data from PhantomBuster to Clay

Ever felt overwhelmed juggling between multiple apps for different tasks?

I feel you.

In the real world, it’s all too common to bounce between apps to manage different projects, reach out to our peers, or even do some simple research.

But Clay is about to change that.

Clay is a platform you can use to integrate and streamline everything you need. It even supports third-party apps like PhantomBuster. How amazing is that!

Perhaps, you’re trying to consolidate scattered data to refine your campaign insights. Or, you want to boost your client outreach. With Clay, all of these can be done with a few clicks.

I’ve written this guide to walk you through pulling data from PhantomBuster to Clay. No jargon or technical skills are needed. 

Hopefully, by the end, you can simplify your workflow using Clay. Let’s get started!

PhantomBuster to Clay result

Creating an Automated Task in PhantomBuster

In this tutorial, we’re going to assume that you already have an active account in PhantomBuster

Before we can integrate PhantomBuster on Clay, we’ll need to set up a few things. 

First, you’ll need to have an existing output file. This is carried out by a simple automated action called a Phantom. 

A Phantom allows you to perform automated tasks for several networks or social media platforms. This includes scraping profile data, following people, liking posts on social media, posting comments, and exporting search results. 

Later on, we’re going to pull this data and enrich them on Clay.

Now, let’s try to add a Phantom.

For the sake of this tutorial, we're aiming to gather a list of US-based digital marketing companies. Here's how to get there:

1) Choose a Phantom

Go to your PhantomBuster dashboard and navigate to the Phantom store. Here, you choose any action you want. In

For this guide, we'll use the LinkedIn search export.

LinkedIn Search Export

2) Connect Your Phantom via Session Cookies

Next, you’ll need to connect your Phantom to your LinkedIn account via a session cookie. If you need help, please refer to this tutorial for more information.

connect Phantom to LinkedIn

3) Add Search Details

There are many ways to add search details in PhantomBuster.

Within the ‘Your searches’ field, you have the option to:

  • enter keywords
  • enter a LinkedIn search URL
  • enter a Google sheet URL containing the keywords or LinkedIn search URLs
  • enter a URL of a CSV file containing the keywords or LinkedIn search URLs

For simplicity, we’ll enter the keywords ‘Digital Marketing United States as shown below.

Phantom searches to scrape

In the Search Category, let’s choose Companies since we are searching for digital marketing companies in the US.

Click save to continue.

4) Configure Phantom Behavior

Let’s set the number of results to scrape per search and launch. 

But before we do that, make sure to follow the rate limits allowed on social media platforms to avoid any issues!

Rate limits are the maximum number of automation you can do in a specific time frame per platform. This measure is implemented by social networks to prevent abuse and ensure fair usage among users. 

If you failed to follow the recommended rate limits, your Phantoms might glitch out, or worse, you could get banned from the platform.

For now, let's limit the results per search and per launch to 10. Then, continue to the next step.

configure Phantom behavior

5) Tweak the Settings and Launch

PhantomBuster provides options to set up manual or automated launches for your Phantoms. For now, we’re going to set everything to manual.

Phantom launch settings

Click 'save', then 'launch'.

Once done, you should see a list of data under the ‘results’ tab. Next, let's enrich this using Clay!

Pull Data from PhantomBuster Using Clay

1) Create a New Table

On Clay, start with a blank table. Add the data you want to enrich, as shown below.

list of data on Clay

2) Add Data Enrichment

Click 'add enrichment' and select 'Pull data' by PhantomBuster.

add enrichment
pull data using PhantomBuster

3) Enter PhantomBuster API Key

On the next window, you’ll be prompted to enter a PhantomBuster API key.

To locate your API key, head over to your PhantomBuster dashboard. Under ‘My workspace settings’, click ‘Add API key’ and copy. 

PhantomBuster API key

Back in Clay, paste the API under the ‘Choose an account’ field to authenticate.

enter API key on Clay

4) Choose Your Agent ID

Next, we’re going to choose an Agent ID. This is the name of the automated task (or Phantom) that you create on our PhantomBuster account.

Recall the task we made: 'Digital Marketing LinkedIn Search Export'. Select this from the dropdown.

select agent ID on Clay

5) Save and Run

Review your settings. Then, click save and run. 

Your table will now display a new column, 'Pull Data', with gathered info.

pulled data from PhantomBuster to Clay

6) Organize Your Data

The next step is to organize the data we’ve just pulled from PhantomBuster. 

Notice that each row contains multiple results. Each row is an object containing lists of information, such as a company name, Linkedin profile, company description, logo URL, and many others.

Let’s organize the data in rows and columns so we can easily enrich them later on. In this tutorial, we’re going to create a new table and write the collected data here.

So, create a new Clay table named 'Affiliate Marketing Test'. Define columns like Niche, Company Name, LinkedIn Profile, and Description.

add new table on Clay

Back to your original table, add an enrichment, and choose ‘Write to Other Table’.

write to other table

Map your data to flow into the appropriate columns of the new table.

write to other table inputs
mapping columns on Clay table
map columns on Clay table

Once everything is set, click save and run.

Your original table should now look similar to the one below. Notice that the ‘Write to Other Table’ column contains 10 values for each row. 

write to other table result

Check your new table. This should now be populated with the organized data, as shown below.

organized data from PhantomBuster to Clay

That’s a Wrap!

Great job! You’ve just learned how to pull data from PhantomBuster to Clay

Now you have the information, the next step is to explore Clay’s features to meet your goals.

For instance, you can further enrich your company list to get the latest news about them. This can be easily done in Clay with a few clicks. Check our tutorial on “How to Find Recent News About Companies Using Clay” to learn more.

And, if you've any questions, just drop a comment. We’ll try our best to help! 

Want To Learn Even More?
If you enjoyed this article, subscribe to our free monthly newsletter
where we share tips & tricks on how to use tech & AI to grow and optimize your business, career, and life.
Written by Christy Cañete
Christy Cañete is a software engineer who's passionate about front-end web design. Not only can she code, but she writes too! She loves breaking down technical topics into super easy tutorials. If you're looking to learn without the jargon, she's your go-to.
Subscribe
Notify of
guest

0 Comments
Inline Feedbacks
View all comments
Join Our Newsletter!
If you enjoyed this article, subscribe to our newsletter where we share tips & tricks on how to make use of some incredible AI tools that you can use to grow and optimize a business
magnifiercross