Vector crawling not working from url

Hi @awilly , that is a good suggestion and something I’ve passed along to the team.

This feature was cancelled a while back due to inactivity but has had renewed interest and is now in triage again as of about 3 weeks ago. We will update again when there’s any news to share on this!

@Mike_M

Update: In the end, we used an API to retrieve the data we wanted rather than web crawling. We’re new to this and didn’t realize API was even an option at first. It turned out to be a much better solution, and we wouldn’t go back to crawling for this use case even if you guys got it working.

Thanks for your attention. We not longer have the sense of urgency we originally posted with.

1 Like

Thanks for the update! Glad you got everything working.