Web Wiz - Green Windows Web Hosting

  New Posts New Posts RSS Feed - Why Does my RSS Feed Max Out At 1000?
  FAQ FAQ  Forum Search   Events   Register Register  Login Login

Why Does my RSS Feed Max Out At 1000?

 Post Reply Post Reply Page  123>
Author
kennywhite View Drop Down
Groupie
Groupie


Joined: 26 February 2009
Location: Indy
Status: Offline
Points: 106
Post Options Post Options   Thanks (0) Thanks(0)   Quote kennywhite Quote  Post ReplyReply Direct Link To This Post Topic: Why Does my RSS Feed Max Out At 1000?
    Posted: 16 October 2009 at 7:23pm
My RSS feed will only display the last 1000 posts on my blog. I've looked through the code multiple times, trying to find the solution. I'm not very savy in ASP, so it wouldn't be surprising if I over looked something simple.
 
Here is my code for rss.asp.
____

<%@LANGUAGE="VBSCRIPT" CODEPAGE="1252"%>
<!--#include file="config.asp" -->
<!--#include file="functions.asp" -->
strSQL = "SELECT * FROM  T_WEBLOG WHERE  b_published = true ORDER BY b_date DESC, b_time DESC"
 
 Set Rs = Server.CreateObject("ADODB.Recordset")
 Rs.ActiveConnection = strConn
 Rs.Source = strSQL
 Rs.CursorType = 0
 Rs.CursorLocation = 2
 Rs.LockType = 1
 Rs.Open()

response.ContentType="text/xml"
response.write "<?xml version=""1.0"" encoding=""ISO-8859-1""?>" & vbcrlf
response.Write "<?xml-stylesheet type=""text/xsl"" href=""rss.xsl""?>" & vbcrlf
response.write "<rss version=""0.91""><channel>" & vbcrlf
response.write "<title>Ryder Reports RSS feed</title>" & vbcrlf
response.write "<link>" & strURL & "</link>" & vbcrlf
 
response.write "<description>An RSS feed for Reports</description>" & vbcrlf
response.write "<language>EN</language>" & vbcrlf

if not Rs.EOF Then
 while not Rs.eof
 
 response.write "<item>" & vbcrlf
 response.write "<title><![CDATA[" & Rs("b_headline") & "]]> </title>"
 response.write "<category><![CDATA[" & Rs("b_category") & "]]></category>"
 response.write "<author><![CDATA[Entered by: " & Rs("b_author") & "]]></author>"
 
 
 
 response.write "<description> <![CDATA[<strong>Requested by:</strong> " & Rs("b_requested") & " &nbsp; &nbsp; &nbsp; <strong>Serial #</strong>" & Rs("b_serial") & " &nbsp; &nbsp; &nbsp; <strong>Location:</strong> " & Rs("b_location") & " &nbsp; &nbsp; &nbsp; <strong>Category:</strong> " & Rs("b_category") & " &nbsp; &nbsp; &nbsp; <strong>Time:</strong> " & Rs("b_minutes") & " Minutes<br>" & Rs("b_content") & "<p>&nbsp;<p>&nbsp;<p> ]]></description>"
 
 
 
 response.write "<date>" & IntToDate(Rs("b_date")) & "</date>" & vbcrlf
 response.write "<time>" & Rs("b_time") & "</time>" & vbcrlf
 response.write "<link>"&strURL&"?view=plink&amp;id="&Rs("id")&"</link>" & vbcrlf
 response.Write("<id>"&Rs("id")&"</id>")
 response.write "</item>" & vbcrlf
 
 rs.movenext
Wend
end if
response.write "</channel></rss>" & vbcrlf
rs.close
set rs=nothing
%>
__
Here is the code for rss.xml. It doesn't seem like this page is actually used. Am I wrong there?
 
__

<?xml version="1.0" encoding="ISO-8859-1"?>
<xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform">
 <xsl:template match="/">
  <html>
   <head>
    <title>RSS</title>
   </head>
   <body>
    <ul>
  <xsl:for-each select="/rss/channel/item">
     <li><a href="{link}"><xsl:value-of select="title" /></a>
   <p><xsl:value-of select="description" /></p>
   </li>
  </xsl:for-each>
    </ul>
   </body>
  </html>
 </xsl:template>
</xsl:stylesheet>
 
Thanks for looking!
Back to Top
dpyers View Drop Down
Senior Member
Senior Member


Joined: 12 May 2003
Status: Offline
Points: 3937
Post Options Post Options   Thanks (0) Thanks(0)   Quote dpyers Quote  Post ReplyReply Direct Link To This Post Posted: 17 October 2009 at 9:34pm
Nothing really jumps out at me, but a couple of things I would look at are:

Is the feed complete from a technical standpoint. e.g. Does it start and end properly (responsewrite it - don't depend upon a feed reader).
Is the last entry truncated?
What is the actual size of the feed (run the feed through http://web-sniffer.net )

There are limits on things. html pages have a size limit of around 100k.
Feed consumers usually have a size limit of 512k, 1024k, or in some instances 2048k.
Feed producers are often subject to limits imposed by web servers or isp's.

If the feed looks to be technically correct, it may be a limit on the number of entries returned by sql. toss some test counter code in to see if sql is only returning 1000 records.
If the last record is truncated, it's likely a CDATA limitation or a restriction on the amount of data returned by the query.
If there actually are more than 1000 records produced within a validly formatted feed, then it's a problem with whatever is used to consume ot a problem with production limits set by the host/isp that are truncating the feed.

Lead me not into temptation... I know the short cut, follow me.
Back to Top
kennywhite View Drop Down
Groupie
Groupie


Joined: 26 February 2009
Location: Indy
Status: Offline
Points: 106
Post Options Post Options   Thanks (0) Thanks(0)   Quote kennywhite Quote  Post ReplyReply Direct Link To This Post Posted: 19 October 2009 at 2:38pm
The code is correct as far as I can tell, but I am far from an ASP guru.
 
The feed size is 1.14 MB
The last message is not truncated at all. I don't think it is a file size issue at all, since it is always the most recent 1000 entries. Never any more, never any less. There is about 1500 entries in the database right now.
 
This is an intranet site running on IIS 6.0 from a Windows Server 2003 box.
 
I'm not really sure how to check for an error with what sql is returning. Could you possibly throw me some sample code?
 
Have you personally seen an RSS feed with more than 1000 entries? I've been looking around, but I have not seen any.
 
Also, do you know of any other easy to configure rss scripts that I could possibly try?
 
Thanks.
Back to Top
WebWiz-Bruce View Drop Down
Admin Group
Admin Group
Avatar
Web Wiz Developer

Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844
Post Options Post Options   Thanks (0) Thanks(0)   Quote WebWiz-Bruce Quote  Post ReplyReply Direct Link To This Post Posted: 19 October 2009 at 2:53pm
In your WHERE clause you are using b_published = True, it maybe worth checking that this field is set to true in your database for all records.

You have not said what type of database you are using? 
Back to Top
kennywhite View Drop Down
Groupie
Groupie


Joined: 26 February 2009
Location: Indy
Status: Offline
Points: 106
Post Options Post Options   Thanks (0) Thanks(0)   Quote kennywhite Quote  Post ReplyReply Direct Link To This Post Posted: 19 October 2009 at 3:29pm
Oh, sorry I forgot that the database connection wasn't shown here. It is an Access database. Each record is published.
Back to Top
WebWiz-Bruce View Drop Down
Admin Group
Admin Group
Avatar
Web Wiz Developer

Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844
Post Options Post Options   Thanks (0) Thanks(0)   Quote WebWiz-Bruce Quote  Post ReplyReply Direct Link To This Post Posted: 19 October 2009 at 4:10pm
I know that Access has loads of limitations, but I don't think there is a maximum amount of returned records.

Try running the SQL query directly in Access and see if it still returns only the first 1,000 entries.
Back to Top
kennywhite View Drop Down
Groupie
Groupie


Joined: 26 February 2009
Location: Indy
Status: Offline
Points: 106
Post Options Post Options   Thanks (0) Thanks(0)   Quote kennywhite Quote  Post ReplyReply Direct Link To This Post Posted: 19 October 2009 at 6:52pm
I ran the query in Access itself and I got back all 1500 results.
Back to Top
WebWiz-Bruce View Drop Down
Admin Group
Admin Group
Avatar
Web Wiz Developer

Joined: 03 September 2001
Location: Bournemouth
Status: Offline
Points: 9844
Post Options Post Options   Thanks (0) Thanks(0)   Quote WebWiz-Bruce Quote  Post ReplyReply Direct Link To This Post Posted: 20 October 2009 at 10:15am
I am at a loss then, maybe there is a 1,000 limit in web browsers of the number of results they will show in an RSS Feed.

Maybe try ATOM instead of RSS and see if that makes a difference.

I've never seen an RSS Feed with more than around 20 entries, otherwise it is allot for someone to look through.
Back to Top
 Post Reply Post Reply Page  123>

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 12.08
Copyright ©2001-2026 Web Wiz Ltd.


Become a Fan on Facebook Follow us on X Connect with us on LinkedIn Web Wiz Blogs
About Web Wiz | Contact Web Wiz | Terms & Conditions | Cookies | Privacy Notice

Web Wiz is the trading name of Web Wiz Ltd. Company registration No. 05977755. Registered in England and Wales.
Registered office: Web Wiz Ltd, Unit 18, The Glenmore Centre, Fancy Road, Poole, Dorset, BH12 4FB, UK.

Prices exclude VAT at 20% unless otherwise stated. VAT No. GB988999105 - $, € prices shown as a guideline only.

Copyright ©2001-2026 Web Wiz Ltd. All rights reserved.