Classic ASP Discussion - Why Does my RSS Feed Max Out At 1000?

Print Page | Close Window

Why Does my RSS Feed Max Out At 1000?

Printed From: Web Wiz Forums
Category: General Discussion
Forum Name: Classic ASP Discussion
Forum Description: Discussion on Active Server Pages (Classic ASP).
URL: https://forums.webwiz.net/forum_posts.asp?TID=27945
Printed Date: 29 March 2026 at 9:20am
Software Version: Web Wiz Forums 12.08 - https://www.webwizforums.com

Topic: Why Does my RSS Feed Max Out At 1000?

Posted By: kennywhite
Subject: Why Does my RSS Feed Max Out At 1000?
Date Posted: 16 October 2009 at 7:23pm

My RSS feed will only display the last 1000 posts on my blog. I've looked through the code multiple times, trying to find the solution. I'm not very savy in ASP, so it wouldn't be surprising if I over looked something simple.

Here is my code for rss.asp.

____


< mailto:%@LANGUAGE=VBSCRIPT" rel="nofollow - %@LANGUAGE="VBSCRIPT " CODEPAGE="1252"%>
<!--#include file="config.asp" -->
<!--#include file="functions.asp" -->
<%
strURL = " http://serv001/reports/" rel="nofollow - http://serv001/reports/ "
strSQL = "SELECT * FROM  T_WEBLOG WHERE  b_published = true ORDER BY b_date DESC, b_time DESC"
 
 Set Rs = Server.CreateObject("ADODB.Recordset")
 Rs.ActiveConnection = strConn
 Rs.Source = strSQL
 Rs.CursorType = 0
 Rs.CursorLocation = 2
 Rs.LockType = 1
 Rs.Open()

response.ContentType="text/xml"
response.write "<?xml version=""1.0"" encoding=""ISO-8859-1""?>" & vbcrlf
response.Write "<?xml-stylesheet type=""text/xsl"" href=""rss.xsl""?>" & vbcrlf
response.write "<rss version=""0.91""><channel>" & vbcrlf
response.write "<title>Ryder Reports RSS feed</title>" & vbcrlf
response.write "<link>" & strURL & "</link>" & vbcrlf
 
response.write "<description>An RSS feed for Reports</description>" & vbcrlf
response.write "<language>EN</language>" & vbcrlf

if not Rs.EOF Then
 while not Rs.eof 
 
 response.write "<item>" & vbcrlf
 response.write "<title><![CDATA[" & Rs("b_headline") & "]]> </title>" 
 response.write "<category><![CDATA[" & Rs("b_category") & "]]></category>"
 response.write "<author><![CDATA[Entered by: " & Rs("b_author") & "]]></author>"
 
 
 
 response.write "<description> <![CDATA[<strong>Requested by:</strong> " & Rs("b_requested") & " &nbsp; &nbsp; &nbsp; <strong>Serial #</strong>" & Rs("b_serial") & " &nbsp; &nbsp; &nbsp; <strong>Location:</strong> " & Rs("b_location") & " &nbsp; &nbsp; &nbsp; <strong>Category:</strong> " & Rs("b_category") & " &nbsp; &nbsp; &nbsp; <strong>Time:</strong> " & Rs("b_minutes") & " Minutes<br>" & Rs("b_content") & "<p>&nbsp;<p>&nbsp;<p> ]]></description>" 
 
 
 
 response.write "<date>" & IntToDate(Rs("b_date")) & "</date>" & vbcrlf
 response.write "<time>" & Rs("b_time") & "</time>" & vbcrlf
 response.write "<link>"&strURL&"?view=plink&amp;id="&Rs("id")&"</link>" & vbcrlf
 response.Write("<id>"&Rs("id")&"</id>")
 response.write "</item>" & vbcrlf
 
 rs.movenext
Wend
end if
response.write "</channel></rss>" & vbcrlf
rs.close
set rs=nothing
%>

Here is the code for rss.xml. It doesn't seem like this page is actually used. Am I wrong there?


<?xml version="1.0" encoding="ISO-8859-1"?>
<xsl:stylesheet version="1.0" xmlns:xsl=" http://www.w3.org/1999/XSL/Transform" rel="nofollow - http://www.w3.org/1999/XSL/Transform ">
 <xsl:template match="/">
  <html>
   <head>
    <title>RSS</title>
   </head>
   <body>
    <ul>
  <xsl:for-each select="/rss/channel/item">
     <li><a href="{link}"><xsl:value-of select="title" /></a>
   <p><xsl:value-of select="description" /></p>
   </li>
  </xsl:for-each>
    </ul>
   </body>
  </html>
 </xsl:template>
</xsl:stylesheet>

Thanks for looking!

Replies:

Posted By: dpyers
Date Posted: 17 October 2009 at 9:34pm

Nothing really jumps out at me, but a couple of things I would look at are:

Is the feed complete from a technical standpoint. e.g. Does it start and end properly (responsewrite it - don't depend upon a feed reader).
Is the last entry truncated?
What is the actual size of the feed (run the feed through http://web-sniffer.net/" rel="nofollow - http://web-sniffer.ne t )

There are limits on things. html pages have a size limit of around 100k.
Feed consumers usually have a size limit of 512k, 1024k, or in some instances 2048k.
Feed producers are often subject to limits imposed by web servers or isp's.

If the feed looks to be technically correct, it may be a limit on the number of entries returned by sql. toss some test counter code in to see if sql is only returning 1000 records.
If the last record is truncated, it's likely a CDATA limitation or a restriction on the amount of data returned by the query.
If there actually are more than 1000 records produced within a validly formatted feed, then it's a problem with whatever is used to consume ot a problem with production limits set by the host/isp that are truncating the feed.

-------------

Lead me not into temptation... I know the short cut, follow me.

Posted By: kennywhite
Date Posted: 19 October 2009 at 2:38pm

The code is correct as far as I can tell, but I am far from an ASP guru.

The feed size is 1.14 MB

The last message is not truncated at all. I don't think it is a file size issue at all, since it is always the most recent 1000 entries. Never any more, never any less. There is about 1500 entries in the database right now.

This is an intranet site running on IIS 6.0 from a Windows Server 2003 box.

I'm not really sure how to check for an error with what sql is returning. Could you possibly throw me some sample code?

Have you personally seen an RSS feed with more than 1000 entries? I've been looking around, but I have not seen any.

Also, do you know of any other easy to configure rss scripts that I could possibly try?

Thanks.

Posted By: WebWiz-Bruce
Date Posted: 19 October 2009 at 2:53pm

In your WHERE clause you are using b_published = True, it maybe worth checking that this field is set to true in your database for all records.

You have not said what type of database you are using?

-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting

Posted By: kennywhite
Date Posted: 19 October 2009 at 3:29pm

Oh, sorry I forgot that the database connection wasn't shown here. It is an Access database. Each record is published.

Posted By: WebWiz-Bruce
Date Posted: 19 October 2009 at 4:10pm

I know that Access has loads of limitations, but I don't think there is a maximum amount of returned records.

Try running the SQL query directly in Access and see if it still returns only the first 1,000 entries.

-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting

Posted By: kennywhite
Date Posted: 19 October 2009 at 6:52pm

I ran the query in Access itself and I got back all 1500 results.

Posted By: WebWiz-Bruce
Date Posted: 20 October 2009 at 10:15am

I am at a loss then, maybe there is a 1,000 limit in web browsers of the number of results they will show in an RSS Feed.

Maybe try ATOM instead of RSS and see if that makes a difference.

I've never seen an RSS Feed with more than around 20 entries, otherwise it is allot for someone to look through.

-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting

Posted By: dpyers
Date Posted: 20 October 2009 at 3:34pm

Just to exclude rss.asp as the problem, try incrementing a counter (i = 1 + 1) just before the set rs = nothing and then write out the counter after you set rs = nothing (response.write "<p>Count = " & i & "</p>"

Run just rss.asp in your browser and see what the counter says. If you don't see the counter, you've hit the http size limitation.

If the counter says 1000, then it's some limitation on what you can return from access via the ado on the web. There's ways to use the ado.command object to page through the db and return blocks of rows/data at a time.

If the counter says 1500, then it's an issue on the xml/rss side. RSS 0.90-.092 had some limitations on title and descriptions - 500 characters, and a limit of 100 characters on links. You may want to try rss 1.0 or 2.0.

Other than that, I'm about tapped out.

-------------

Lead me not into temptation... I know the short cut, follow me.

Posted By: WebWiz-Bruce
Date Posted: 20 October 2009 at 3:42pm

That reminds me there is a 100Kb limit on the ASP response object. So you can only out put pages that are less than 100Kb as this also includes any headers, cookies, etc. set by your website.

-------------
https://www.webwiz.net/web-wiz-forums/forum-hosting.htm" rel="nofollow - Web Wiz Forums Hosting
https://www.webwiz.net/web-hosting/windows-web-hosting.htm" rel="nofollow - ASP.NET Web Hosting

Posted By: dpyers
Date Posted: 20 October 2009 at 4:22pm

WebWiz-Bruce wrote:

That reminds me there is a 100Kb limit on the ASP response object. So you can only out put pages that are less than 100Kb as this also includes any headers, cookies, etc. set by your website.

That's what I was thinking about when I said http limit of 100K. Must be getting senile - again!

-------------

Lead me not into temptation... I know the short cut, follow me.

Posted By: dpyers
Date Posted: 26 October 2009 at 8:02pm

kennywhite, did you ever figure this out?

-------------

Lead me not into temptation... I know the short cut, follow me.

Posted By: kennywhite
Date Posted: 27 October 2009 at 3:42pm

No. I haven't figured it out yet. I've posted the same question on other forums, but no one is ever as helpful as the folks here.

The person who set up this feed http://pulssr.com/rss/0.rss" rel="nofollow - http://pulssr.com/rss/0.rss said that they tested it out with over 1000 entries and they had no problems, but I didn't get a response when asking for source code.

Any new ideas? :D

Posted By: dpyers
Date Posted: 27 October 2009 at 6:05pm

Nope. Was hoping you had discovered something.

Did you try Bruce's suggestion to set it up as an atom feed?

-------------

Lead me not into temptation... I know the short cut, follow me.

Posted By: kennywhite
Date Posted: 27 October 2009 at 7:37pm

I have no tried that yet. I wanted to try to find a solution with RSS before I move on.

Posted By: kennywhite
Date Posted: 27 October 2009 at 7:53pm

I did, however, try spitting out every entry into an asp page and it will display all 1,500 or so with no problem.

It has to be a problem with RSS/XML. The versions of both of them that are documented in the code is a bit older. Is there a good site that may show the differences of the syntax in the different versions?

Posted By: 123Simples
Date Posted: 27 October 2009 at 8:07pm

I don't know if this will help Kenny but I http://blog.feedblitz.com/2009/08/breaking-512k-rss-feed-limit.html" rel="nofollow - found this when searching the terms:

rss feeds limits

I'm only guessing

-------------
http://www.123simples.com/" rel="nofollow - Visit 123 Simples Web Design

Posted By: dpyers
Date Posted: 27 October 2009 at 8:08pm

Most of the things I've seen itemizing the differences between rss versions were pretty technical and "jargonized".
RSS is (should be) backward compatible. I'd just try changing the version to 1.0 or 2.0.
IIRC, versions 0.93 and 0.94 were pulled after release. The version after 1.0 would be 2.0.

If you get the same results after changing the versions, I'd suspect bad XML

-------------

Lead me not into temptation... I know the short cut, follow me.

Posted By: 123Simples
Date Posted: 27 October 2009 at 8:10pm

And http://www.bukisa.com/articles/117504_increase-the-50-item-limit-on-blogger-rss-feeds" rel="nofollow - this link may help as well

-------------
http://www.123simples.com/" rel="nofollow - Visit 123 Simples Web Design

Posted By: kennywhite
Date Posted: 28 October 2009 at 4:02pm

I tried a few tips from the links that you MrTWS. I had no luck there.

I also tried changing the version numbers. I removed the tag linking the XML stylesheet and I was able to display all of the database records, but they are really sloppy and the neat little search box on the side is missing.

I think that issolates the problem to the XML, but I'm only 99.9% on that.

We only use IE here at work (corporate policy), so I had never tried it on Chrome or Mozilla, but today I decided to give it a shot (with the XML file re-linked, of course) and they will both display every database record, but I don't have the search box. The ability to search the entries is what makes it important in the first place.

With these new facts, I'm going to see what my brain can come up with, hopefully one of you will find a light bulb over your head that you can lend me.

This does have to work in IE, though.

Posted By: kennywhite
Date Posted: 10 November 2009 at 3:39pm

So... I think the limitation is with XML. I created this generic RSS page, with the data manually entered in and saved it as an asp, php and html page. No matter what, it would never go over 1000.

[code]

<?xml version="1.0"?>
<note>
<from>Jani</from>
<to>Tove</to>
<message>Norwegian: æøå. French: êèé</message>
</note>

The file above, note_encode_none_u.xml will NOT generate an error. But if you specify a single-byte encoding it will.

The following encoding (open it), will give an error message:

<?xml version="1.0" encoding="windows-1252"?>

The following encoding (open it), will give an error message:

<?xml version="1.0" encoding="ISO-8859-1"?>

The following encoding (open it), will give an error message:

<?xml version="1.0" encoding="UTF-8"?>

The following encoding (open it), will NOT give an error:

<?xml version="1.0" encoding="UTF-16"?>

[\code]

Posted By: kennywhite
Date Posted: 10 November 2009 at 3:42pm

Pasted the wrong thing. Sorry..

Here is the code. :)


<?xml version="1.0"?>
<rss version="2.0">
<channel>
 
<title>The title of my RSS 2.0 Feed</title>
<link>http://www.example.com/</link>
<description>This is my rss 2 feed description</description>
<lastBuildDate>Mon, 12 Sep 2005 18:37:00 GMT</lastBuildDate>
<language>en-us</language>
 
<item>
<title>Title of an item</title>
<link>http://example.com/item/123</link>
<guid>http://example.com/item/123</guid>
<pubDate>Mon, 12 Sep 2005 18:37:00 GMT</pubDate>
<description>[CDATA[ This is the description. ]]</description>
</item>
 

<item>
<title>Title of an item</title>
<link>http://example.com/item/123</link>
<guid>http://example.com/item/123</guid>
<pubDate>Mon, 12 Sep 2005 18:37:00 GMT</pubDate>
<description>[CDATA[ This is the description. ]]</description>
</item>
<item>
<title>Title of an item</title>
<link>http://example.com/item/123</link>
<guid>http://example.com/item/123</guid>
<pubDate>Mon, 12 Sep 2005 18:37:00 
GMT</pubDate>
<description>[CDATA[ This is the description. ]]</description>
</item>
 

<item>
<title>Title of an item</title>
<link>http://example.com/item/123</link>
<guid>http://example.com/item/123</guid>
<pubDate>Mon, 12 Sep 2005 18:37:00 GMT</pubDate>
<description>[CDATA[ This 
is the description. ]]</description>
</item>"
 
 

</channel>
</rss>