GOALS My GOAL - Creating 5 AI sites, 5 Different ways, 1 MILLION VISITS!

[Bourgis]

Hey everyone,

I've been in the game of crafting auto-generated, AI-driven, and scraped sites for quite a while.

I personally train my AI NLP models to dynamically generate text and produce contextually relevant content. I'm constantly at it, scraping all day, every day. I've taken on the toughest niches with the longest tails.

My sites have made their rounds on this forum, as well as Reddit, and even a couple of Russian forums (that last one makes me particularly proud).


This journey stems from a challenge thrown down by a couple of fellow webmasters. During a brainstorming session about AI and auto-generation, we decided to launch brand new projects and document our progress along the way.

Instantly, new Slack channels were created, and we got to work. I've chosen to share and document my journey on this forum as well.

The Journey

I'll be building a total of 5 sites, starting from scratch. Each site will have its own unique characteristics, and I'll provide a breakdown of each below.

I've developed custom tools, scripts, and APIs that either handle the entire process from scraping to posting or are segmented to handle specific aspects of the job.

For the most part, I'll be using WordPress, except for Site #4, which involves a custom script I put together for testing a prototype.



Monetization

I manage various websites, spanning both whitehat and blackhat approaches. Up until now, my focus has mainly been on PPC, CPA, lead generation, and a touch of Adsense. This journey marks the initiation of my foray into utilizing Display.

Let's get started -

--

Site #1

Site Type: PAA Only. No rewriting (Augmented in a few places using AI).

Featured Images: None.

Domain Type: Fresh, Not Registered Before.

Current Progress: Check below.

Indexing API: Yes.

--

Site #2

Site Type: Fine-tuned AI model-generated content + a touch of rewritten PAA using my custom paraphraser. Significantly augmented using AI (Numerous unique semantically relevant AI content added to every WordPress post).

Featured Images: Yes, incorporating beautiful, unique custom images retrieved from APIs, modified, and parsed by my system before being posted to the article.

Domain Type: Expired, re-registered. Currently boasts 20 AI-generated posts, all indexed and ranking.

Current Progress: Check below.

Indexing API: No.

--

Site #3

Site Type: A distinctive variation on PAA setup that I've experienced some success with. Unable to disclose further details.

Featured Images: None.

Domain Type: New, never registered before.

Current Progress: Check below.

Indexing API: Yes.

--

Site #4

Site Type: Rewritten PAA site - all answers are paraphrased. (Deviation from the traditional WordPress format).

Featured Images: None.

Domain Type: New, never registered before.

Current Progress: Check below.

Indexing API: Yes.

--

Site #5

Site Type: Pure AI-Generated Content. No PAA, No questions, No scraping. Solely AI-generated content.

Featured Images: Yes, incorporating beautiful unique custom images retrieved from APIs, modified, and parsed by my system before being posted to the article.

Domain Type: New, never registered before.

Current Progress: Check below.

Indexing API: No.

-

Current Progress

Site #1

• Domain Successfully Registered
• Completed Keyword Research
• Extracted and Sanitized 178,000 Keywords

Site #2

• Domain Successfully Registered (Site was already live)
• Completed Keyword Research
• Extracted, Sanitized, and Grouped 116,000 Keywords into Categories

Site #3

• Successfully Registered Domain
• Completed Keyword Research
• Extracted, Sanitized, and Grouped 180,000 Keywords into Categories

Site #4

• Awaiting Domain Registration
• Completed Keyword Research
• Extracted, Sanitized, and Grouped 160,000 Keywords into Categories

Site #5

• Successfully Registered Domain
• Completed Keyword Research
• Extracted, Sanitized, and Grouped 129,000 Keywords into Categories

So even more info :

1. How do you create content?

I utilize my own finely tuned models, including both GPT-3 and non-GPT-3. I consistently explore datasets and engage in model training.

1. What tool do you use for Paraphrasing?

The choice depends on my specific requirements, but I often rely on T5, especially with numerous custom-trained models. If you're interested in delving into paraphrasing, you can find more information in my post here: https://huggingface.co/ramsrigouthamg/t5-large-paraphraser-diverse-high-quality

1. Do you link GSC/GA to this site?

Certainly, all my sites are connected to GSC, albeit using different accounts. I frequently switch between GA and https://matomo.org

1. In what language are your scripts written?

Primarily Python, with some implemented in Node.js.

1. Where do you host your scripts?

I utilize a couple of robust GPU setups in my office for running text-transformers. Additionally, I maintain a few servers on Vultr and AWS.

1. Are you willing to sell your script/setup?

No, I'm not.

1. How do you handle backlinks?

For my blackhat sites, I generate social signals (automated) and employ Web 2.0 strategies when launching a new site.

1. Which niche are you focused on?

I'd rather not discuss that.


Feel free to ask more questions. I'll respond here and provide answers to the best of my ability.



I plan to keep you in the loop with updates on this thread, posting new information once or twice a week. While I'll be actively answering questions, it's worth noting that I have other projects in the pipeline. The main concept driving these efforts is automation for scalability. I'll continue developing new sites and enhancing the ones I already have.

 

[TheExecutor]

I'll be keeping an eye on your journey. I actually embarked on a similar one myself, creating A.I. content but taking the manual route. How do you go about indexing the links? Best of luck on your journey!

 

[RollPaper]

You're looking solid! Best of luck in reaching your goals.

 

[Execusp]

This is a great approach to follow. Best of luck, mate!

 

[SosaHelpful]

Sounds good. Best of luck!

 

[Mountaili]

This is crazy! If you can, maybe create a paid course or something to teach how to do this (if you're interested). I can't stop thinking about how some people are making $XXX,XXX a month with AI websites.

 

[Glamoco]

This is going to be such an exciting adventure! I really hope you reach your goals quickly.

I’m curious about how you find images and add them to your sites. I’m stuck on that part and could use some help with inserting images.

 

[Rhytocen]

I'm following along! Can't wait to see where this journey goes!

 

[Ormesha]

I utilize a couple of robust GPU setups in my office for running text-transformers. Additionally, I maintain a few servers on Vultr and AWS.

What kind of GPUs do you use for your models, and how many? How big are the models? Do you think they could run on a system with two 2080ti GPUs and about 24GB of VRAM? What do you need for running inference?

Also, how long did it take to train them? I'm really curious about the setup and infrastructure you use for machine learning.

 

[Discoverol]

This is crazy! If you can, maybe create a paid course or something to teach how to do this (if you're interested). I can't stop thinking about how some people are making $XXX,XXX a month with AI websites.

Hey, you can totally learn AI by yourself! There are so many resources and books out there. Even if he sells an e-book, it probably won’t be as easy to grasp everything as you might think.

 

[Shmoenevo]

This is such an exciting journey! Good luck with everything—I'll definitely be following along!

1. Where do you host your scripts?

I utilize a couple of robust GPU setups in my office for running text-transformers.

Just curious—what kind of GPUs do you use? Have you found any good deals on new ones lately? With the crypto crash, some GPUs are much more affordable now compared to a year or two ago.

I actually bought a second-hand RTX 3090 last week for $1200 (it was used for mining, so it's not in perfect shape, but it works). It’s now part of our office GPU "fleet" that we use for testing. The same GPU was going for $3000–$3500 last year! I know the RTX 3090 isn’t ideal for machine learning since it’s a gaming GPU, but it’s still pretty powerful. The A100 is still super expensive, though!

By the way, I'd also love to know your strategy for keyword research on these sites. Thanks!

 

[Discoverol]

This is such an exciting journey! Good luck with everything—I'll definitely be following along!


Just curious—what kind of GPUs do you use? Have you found any good deals on new ones lately? With the crypto crash, some GPUs are much more affordable now compared to a year or two ago.

I actually bought a second-hand RTX 3090 last week for $1200 (it was used for mining, so it's not in perfect shape, but it works). It’s now part of our office GPU "fleet" that we use for testing. The same GPU was going for $3000–$3500 last year! I know the RTX 3090 isn’t ideal for machine learning since it’s a gaming GPU, but it’s still pretty powerful. The A100 is still super expensive, though!

By the way, I'd also love to know your strategy for keyword research on these sites. Thanks!

Why did you get that GPU? What kind of model do you train with it?

 

[Shmoenevo]

Why did you get that GPU? What kind of model do you train with it?

I'm not using the RTX 3090 for training—I'm just running some pre-trained or fine-tuned AI models on it, like GPT-J 6B. It's too slow for training medium-sized models like GPT-J. However, if someone wanted to test fine-tuning this model with 8-bit weights, it might not be as slow, but I'm not sure the quality would be the same with that version.

Here’s a link if you're interested:
GPT-J 6B 8bit

 

[Discoverol]

I'm not using the RTX 3090 for training—I'm just running some pre-trained or fine-tuned AI models on it, like GPT-J 6B. It's too slow for training medium-sized models like GPT-J. However, if someone wanted to test fine-tuning this model with 8-bit weights, it might not be as slow, but I'm not sure the quality would be the same with that version.

Here’s a link if you're interested:
GPT-J 6B 8bit

How fast does it run? I tried using the CPU, but it was really slow, and the results weren’t what I was expecting.

 

[Bourgis]

I'll be keeping an eye on your journey. I actually embarked on a similar one myself, creating A.I. content but taking the manual route. How do you go about indexing the links? Best of luck on your journey!

For WordPress, it’s pretty simple—I use Rankmath's Instant Indexing.

For non-WordPress sites, I made a small script that grabs new URLs and submits them to Google every 48 hours. It runs on a Cron job.

This is crazy! If you can, maybe create a paid course or something to teach how to do this (if you're interested). I can't stop thinking about how some people are making $XXX,XXX a month with AI websites.

I'm not really into the whole "Guru" model of offering a one-time paid course. I’m thinking about doing something more like a follow-along or setup service in the future.

Cheers, man!

This is going to be such an exciting adventure! I really hope you reach your goals quickly.

I’m curious about how you find images and add them to your sites. I’m stuck on that part and could use some help with inserting images.

I use APIs from Unsplash, Pexels, and a few other sites, then use Python libraries to process the images and turn them into featured images.

What kind of GPUs do you use for your models, and how many? How big are the models? Do you think they could run on a system with two 2080ti GPUs and about 24GB of VRAM? What do you need for running inference?

Also, how long did it take to train them? I'm really curious about the setup and infrastructure you use for machine learning.

My local machines are only used for inference. I have one with a 2080ti and another with 2 x RTX3090s.

For training, I use Amazon Sagemaker. It saves all the trained models to S3, and if you know what you're doing, you can download those models and use them on your local setup or even on a cheaper VM.

This is such an exciting journey! Good luck with everything—I'll definitely be following along!


Just curious—what kind of GPUs do you use? Have you found any good deals on new ones lately? With the crypto crash, some GPUs are much more affordable now compared to a year or two ago.

I actually bought a second-hand RTX 3090 last week for $1200 (it was used for mining, so it's not in perfect shape, but it works). It’s now part of our office GPU "fleet" that we use for testing. The same GPU was going for $3000–$3500 last year! I know the RTX 3090 isn’t ideal for machine learning since it’s a gaming GPU, but it’s still pretty powerful. The A100 is still super expensive, though!

By the way, I'd also love to know your strategy for keyword research on these sites. Thanks!

I mentioned it above—1x 2080ti and 2x 3090s.

Like you, the 3090s were recent buys for me too, and I got them used. As long as they do the job, right?

Thank goodness the prices are lower now.

Still, I’m moving a lot of my work to MLaaS for now. It lets me follow the PAAG model, and running tests and prototypes is pretty straightforward.

I’ve also been looking at the A100, but honestly, it would be overkill for me at the moment.

Since this is more of an "output-focused" project (where I generate, publish, and push content out) rather than a "process-focused" one (where a big model is trained to do a task or generate outputs in a closed system), I think my current setup is enough for now.

The largest model I'm working with right now is T0PP—it's a pretty cool transformer model. At over 40GB, it's massive! I'm testing out what it can do.

 

[Shmoenevo]

How fast does it run? I tried using the CPU, but it was really slow, and the results weren’t what I was expecting.

I’m not sure... I’ve never tried the 8-bit version on a CPU. But I think it would still take a long time to generate anything on the CPU. However, if you choose to run it on a GPU, an 8GB one (like the GTX1070) should work well. The GTX1080Ti should be enough for fine-tuning this version.

 

[Sleekko]

After that, they’ve been really interested in the PAA website!

 

[Sleekko]

How fast does it run? I tried using the CPU, but it was really slow, and the results weren’t what I was expecting.

I don’t think it will slow things down (especially with a CPU). The 8-bit thing mainly just affects how much memory it uses, if I remember correctly.

 

[ThinkWar]

After that