Remove the list view threshold (5000 by default)
This limit has always been a bit laughable, and is even more so as we develop more client side applications. In SharePoint 2007 we didn't have this limit and were allowed to make our own mistakes. Now that hardware is so much more powerful, we need this limit removed so that we can build enterprise-class applications.
The 5,000 item threshold is likely here to stay. We are aware that it takes awareness on both sides to get past this limitation: list owners have to build the right fields, indices, and indexed views so that end user queries can run successfully in large lists. And then, end users have to run the correct queries – they can’t just open the root of the list, they have to use a filtered, indexed view.
We want to pursue work that helps on both these ends – for example, proactively indexing more lists, making suggestions to list owners for views to create that will help end users, and helping end users at query time pick filters that will unblock their queries. Additionally, we want to increase our support for running more types of queries in large lists when an index is present – for example, instead of requiring an indexed filter for every query, maybe an indexed could suffice.
No guarantees or timelines yet, but that’s the way we’re thinking about the problem. Does that sound reasonable?
"The 5,000 item threshold is likely here to stay"
This arbitrary number is the worst limitation you could have thought up to cripple online sharepoint.
Every single other cloud storage has no such restriction - even worse, on premises sharepoint can be configured too in that way - making transition of existing structures de facto impossible.
Personal onedrive folders (private and office365 business) are not limited to 5000 files either.
Counting versions of documents against the 5000 limit just is the cherry on top of this whole craziness. Not even small companies can work with this without completely rebuilding their structures, which is definitely NOT a goal when moving to office365.
This issue has repeatedly blocked transitioning from google docs and is causing all kinds of problems with people ending up on dropbox, box.com with business data because office365 azure sharepoint is just not fit for use.
I do not care wheter it has a gazillion super nifty features to work with (that roughly 0.0005% of all customers use or care about) it has to be able to compete with other cloud based solutions when it comes to the basics.
number of files in a given library - you do not get more basic than that.
Simply syncing a library with a local machine fails if there are more than 5000 items in the library. You can't expect admins to create a new library, migrate part of the old library and configure new sync jobs, then reconfigure the network shares, every time a library hits 5000 items. If the list view limit can't be addressed the OneDrive for Business sync client needs to be more intelligent in splitting up the queries and running the job in chunks.
This 5000 threshold limit is a joke in enterprise uses. Users need to see all the items in a single view to analyze data and make good decision. Setting up multiple views and then combining them in excel or in other apps is cumbersome and bad bad experience. Goal should be to help getting things done easier ways but not complicated ways. Because of this many users moved on to other solutions.
Microsoft only limiting themselves because of this...
This could be resolved if lists wern't so horribly inefficient in SQL. How many SQL queries you want to do just to get a list of items!
The 5.000 item limit for a list is really a show stopper, if you want to use this list as a reference for other lists/libraries (through a lookup, see also https://sharepoint.uservoice.com/forums/330321-sharepoint-search/suggestions/13002084-lookup-on-lists-over-5-000)
In this time it is not acceptable to limit enterprises to this small amount of data.
Guillaume OBSER commented
I plan to abandon Sharepoint in 2017, SharePoint is became to complcated to maintain due to this limit. Using sharepoint was a mistake and this application is clearly the stepchild of the Office 365 tools.
Eric Alexander commented
No matter how much you preplan for large lists, something always changes down the line and you become powerless to do anything about it. Users can keep adding, and adding, and adding, and you as an administrator have NO means to help them. Moving or deleting files to get under 5000 items causes a whole range of problems; it's clumsy, slow, difficult, time consuming, and can lead to 404s as people try to access content that has been moved. Increase the limit, give us a happy hour, or update TechNet to show the actual boundary of SharePoint Online to be 5,000 items, not 30 million.
This is a big show stopper every time we want to convert a team from using Excel, FileMaker Pro or Access to a SP site with multiple lists and look ups.
Check the convoluted behavior of the LVT https://ktnnsharepoint.wordpress.com/2016/08/02/big-lists-threshold/
That’s why it has to be improved.
I cannot believe that anyone would scroll through 5,000+ list items (& documents), BUT we do need to be able to easily filter a 5,000+ lists and/or retrieve calculations on the results of 5,000+ so is a possible solution.....
Provide with every list a filter/refiner web part that appears above the list if switched on lets say in the view settings. The web part could auto show the fields that have been set in the view settings, so users can select from option fields, select dates, etc...The list on open can either show no data or the first 'x' number of results based on the view and a message informing the user that only 'x' is being shown. If the refine/search results is over 5,000+ show the max amount but provide any count/sum set in the view. Just putting it out there (maybe someone below has !).
Since other online storage services don't have this problem, it's pretty clear it's caused by the way SP gets data from the db. SP is an antiquated server based platform probably not well suited to online use in its current form. The idea that SP has to request all items in a list to return a filtered view of say 25 items is absurd. The filtering should happen before the request gets sent but SP simply doesn't work that way and until it's modernized (or in typical Msft fashion, replaced), it's not fit for enterprise use.
The 5,000 file limit is a massive problem for small business users of Office 365. Those wanting to move to a one-stop modern Office/Email/File management system face unreasonable restrictions due to this limit. While SharePoint is powerful and does make overcoming this limit possible with customized list views, most small businesses aren't going to take the time to administer SharePoint sites. Instead they're stuck paying the monthly subscription fee for Office 365 and paying more for a Dropbox or Box licence.
You have to fix this and make the SharePoint/OneDrive for business services more appealing for those wishing to migrate from Dropbox or Box.
Please make searching for items in document libraries with more than 5000 items work.
If a search query is triggered from within the document library, and the query pulls back a large number of results - clicking the 'See more results' link shows no items at all. A really poor experience and confusing for end users.
Franchesca V Havas commented
I agree that this limit needs to be raised. As a SharePoint developer from the 2001 database beta version we used in Texas to today I can say that this is by far one of the top 10 problems we are encountering today.
Please raise the view limit!
Marc Wenning commented
this limit really needs to raised, 5,000 items is way to low. Needs to be somewhere in the 40-50,000 item limit range for sharepoint online. Please raise the view limit!!!
Andy Dale commented
The 5000 limit causes me endless problems. I keep creating and changing views, have all key columns indexed but still get call from irate customer every few months saying 'Threshold Limit has been reached'. The issue is that to pull all items back on an individual (patient) we have a link that searches all the items in the list. Please, please find a way to fix this biggest frustration.
This limits creates a ton of confusion for IT and end users. Our customer thinks their data is missing. 5,000 item limit is simply way too low, especially when SharePoint lists is seen as a replacement for databases in certain cases. You HAVE to come up with something better...
Within our 400 person organization, I'm the only IT resource to keep everything IT running. File shares are easy to maintain - they just work. This limitation on views effectively prevents us moving file shares to SharePoint as I lose the ability to edit permissions when there are more than 5000 items in a library - that's after breaking down 8 main shares into over 50 libraries to try and get around this limit.
I wasted many hours zipping and shuffling data around only to find users had once again gone over 5000 items afte a few weeks. It's too hard to maintain.
Pascal van Alphen commented
Hi SharePoint Team,
I'm sorry but that line of thinking doesn't sound reasonable to me. I agree that there are definitely situations in which you can work around the issue using appropriate views or indexes, but there are simply too many common business scenarios in which this is not possible.
What if the most important business information around a customer's documents - the fields you really want to filter on - are multi-value lookups? In that case you get no index option, no filter option, so in essence your existing most important library views become useless.
Limiting the view based on something like a start and end date is often not a workable solution.
Then there is the issue where you need to query your entire list based on certain criteria. I've run into this problem not only in views but also in some selections done from workflows. As a UI limit I can fully understand a 5000 limit, but for a selection in the background?
Please understand that this is truly a deal-breaker for several of the customers that I work for. If you seriously want to keep talking about SharePoint as providing 'enterprise grade' solutions (quote from the Future of SharePoint event on May 4th, 2016) then you simply have to get rid of this limitation.
Andi Fandrich commented
Microsoft should not "think about it" but just plain fix it. It is 2016! Ever heard of big data?