Following debugging I identified that the issue is that my service is currently blocked from fetching data from CurseForge, I have reached out to a CurseForge team member who has informed me that as of around March 17th CurseForge is blocking anybody from scraping the site. I'm not sure about the next steps, whether I have to shut the widget down or receive an exception and continue to run it as is, or receive an exception and modify the way that it functions -- perhaps widget only, no api. I'll provide you with an update when I know more about the next steps.
Following debugging I identified that the issue is that my service is currently blocked from fetching data from CurseForge, I have reached out to a CurseForge team member who has informed me that as of around March 17th CurseForge is blocking anybody from scraping the site. I'm not sure about the next steps, whether I have to shut the widget down or receive an exception and continue to run it as is, or receive an exception and modify the way that it functions -- perhaps widget only, no api. I'll provide you with an update when I know more about the next steps.
As the widget is still not updating I guess curseforge is still bloking everything? Or has changed something?
As the widget is still not updating I guess curseforge is still bloking everything? Or has changed something?
I've heard back from the CurseForge team and it looks possible that within the next few weeks the service may be able to resume providing up to date data, however, this may be delayed so I cannot provide a guarantee -- but I expect it will be before the end of May. Sorry for the ongoing inconvenience
As the widget is still not updating I guess curseforge is still bloking everything? Or has changed something?
I have good news! The widget data system is back online meaning you'll now see new data again. As of this post all projects are updated with new data and will be updated every ~30 minutes. Thanks to the help of the CurseForge team we're back in action, and there shouldn't be any further issues. Please PM me if you run into any further issues with your widgets.
I have good news! The widget data system is back online meaning you'll now see new data again. As of this post all projects are updated with new data and will be updated every ~30 minutes. Thanks to the help of the CurseForge team we're back in action, and there shouldn't be any further issues. Please PM me if you run into any further issues with your widgets.
I am currios, is it possible the API has some kind of spam protection ? I am askign becuase I made a little porgramm downloading/updating mods if you provide the minecraft version & curse id, but it failes (with timeouts) if I try to update over 20 mods at once. Is there something I am doing wrong wiht the API ?
I am currios, is it possible the API has some kind of spam protection ? I am askign becuase I made a little porgramm downloading/updating mods if you provide the minecraft version & curse id, but it failes (with timeouts) if I try to update over 20 mods at once. Is there something I am doing wrong wiht the API ?
There isn't any rate limiting (as far as I remember, it's been a while since I worked on it) so I wouldn't expect you to experience any issue with updating 20 mods at once. Furthermore, there are other projects that do this: every 5 (?) minutes they update all of their mods at once, which means many concurrent requests. Have you been able to isolate the specific count as 20, or is that a rough estimate? I can do some digging to determine the problem if you can provide more information, such as the mods you're trying to get data for and whether or not it's an exact count (20) or a rough estimate. Thanks!
There isn't any rate limiting (as far as I remember, it's been a while since I worked on it) so I wouldn't expect you to experience any issue with updating 20 mods at once. Furthermore, there are other projects that do this: every 5 (?) minutes they update all of their mods at once, which means many concurrent requests. Have you been able to isolate the specific count as 20, or is that a rough estimate? I can do some digging to determine the problem if you can provide more information, such as the mods you're trying to get data for and whether or not it's an exact count (20) or a rough estimate. Thanks!
It was a rough estimate, I noticed it because it was failing at the same time and keept failing from there on, maybe this was a proivder issue, I will dig into it. (It worked without issues at first)
It was a rough estimate, I noticed it because it was failing at the same time and keept failing from there on, maybe this was a proivder issue, I will dig into it. (It worked without issues at first)
I don't have any obvious errors logged, so I don't think it's an issue at my end -- is it possible your connection is saturated, or are you getting a timeout response from my server? If you can provide any more information -- specific projects you're trying to query, a full list would be perfect but even a subset of the timeout URLs would be good -- that would be great! Thanks.
-
View User Profile
-
View Posts
-
Send Message
Curse PremiumAs it is still broken, any news on this ?
-
View User Profile
-
View Posts
-
Send Message
Retired StaffFollowing debugging I identified that the issue is that my service is currently blocked from fetching data from CurseForge, I have reached out to a CurseForge team member who has informed me that as of around March 17th CurseForge is blocking anybody from scraping the site. I'm not sure about the next steps, whether I have to shut the widget down or receive an exception and continue to run it as is, or receive an exception and modify the way that it functions -- perhaps widget only, no api. I'll provide you with an update when I know more about the next steps.
-
View User Profile
-
View Posts
-
Send Message
Curse PremiumAs the widget is still not updating I guess curseforge is still bloking everything? Or has changed something?
-
View User Profile
-
View Posts
-
Send Message
Retired StaffI've heard back from the CurseForge team and it looks possible that within the next few weeks the service may be able to resume providing up to date data, however, this may be delayed so I cannot provide a guarantee -- but I expect it will be before the end of May. Sorry for the ongoing inconvenience
-
View User Profile
-
View Posts
-
Send Message
Retired StaffI have good news! The widget data system is back online meaning you'll now see new data again. As of this post all projects are updated with new data and will be updated every ~30 minutes. Thanks to the help of the CurseForge team we're back in action, and there shouldn't be any further issues. Please PM me if you run into any further issues with your widgets.
-
View User Profile
-
View Posts
-
Send Message
Curse PremiumHurray \o/ Thanks for the efford
-
View User Profile
-
View Posts
-
Send Message
Curse PremiumI am currios, is it possible the API has some kind of spam protection ? I am askign becuase I made a little porgramm downloading/updating mods if you provide the minecraft version & curse id, but it failes (with timeouts) if I try to update over 20 mods at once. Is there something I am doing wrong wiht the API ?
-
View User Profile
-
View Posts
-
Send Message
Retired StaffThere isn't any rate limiting (as far as I remember, it's been a while since I worked on it) so I wouldn't expect you to experience any issue with updating 20 mods at once. Furthermore, there are other projects that do this: every 5 (?) minutes they update all of their mods at once, which means many concurrent requests. Have you been able to isolate the specific count as 20, or is that a rough estimate? I can do some digging to determine the problem if you can provide more information, such as the mods you're trying to get data for and whether or not it's an exact count (20) or a rough estimate. Thanks!
-
View User Profile
-
View Posts
-
Send Message
Curse PremiumIt was a rough estimate, I noticed it because it was failing at the same time and keept failing from there on, maybe this was a proivder issue, I will dig into it. (It worked without issues at first)
-
View User Profile
-
View Posts
-
Send Message
Retired StaffI don't have any obvious errors logged, so I don't think it's an issue at my end -- is it possible your connection is saturated, or are you getting a timeout response from my server? If you can provide any more information -- specific projects you're trying to query, a full list would be perfect but even a subset of the timeout URLs would be good -- that would be great! Thanks.
Komputer
Is Forge still being made for newer MC games? I found that some my go-to mods i used Forge for aren't using it anymore.
Thanks for a mod to try out