Saving a huge dataset into SQL table in a XML column - MS SQL, C#.Net

Posted by NLV on Stack Overflow See other posts from Stack Overflow or by NLV
Published on 2010-04-19T07:01:33Z Indexed on 2010/04/19 7:03 UTC
Read the original article Hit count: 370

Filed under:

dataset

|

Xml

|

sql-server-2005

Hello all

I'm having a requirement where i've to save a dataset which has multiple tables in it in a sql table XML column by converting into an XML.

The problem is that in some cases the dataset grows extremely huge and i get OutOfMemoryException.

What i basically do is that i convert the dataset into an xml file and save it in the local disk and then load the XML again and send it as a stored procedure parameter. But when i write the dataset xml into the disk the file sizes over 700 Mb and when i load it in the XMLDocument object in memory i get OutOfMemoryException.

How can get the dataset xml without saving it in a file and re-reading it again?

Thank You

NLV

© Stack Overflow or respective owner

Related posts about dataset

Dataset -> XML Document - Load DataSet into an XML Document - C#.Net

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello I'm trying to read a dataset as xml and load it into an XML Document. XmlDocument contractHistoryXMLSchemaDoc = new XmlDocument(); using (MemoryStream ms = new MemoryStream()) { //XmlWriterSettings xmlWSettings = new XmlWriterSettings(); //xmlWSettings.ConformanceLevel = ConformanceLevel… >>> More
Combine multiple dataset columns to one dataset

as seen on Stack Overflow - Search for 'Stack Overflow'
I have multiple datasets that I would like to combine into one. There is a common ID field that can be associated to each row. Calling Merge on the dataset will add additional rows to the dataset, but I would like to combine the additional columns. There are too many fields to do this in one query… >>> More
Making a DataSet from another DataSet

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi folks I have a client-server project (small project for companies in C#) and the server has a DataSet with some tables (there is no Database for some reasons so we save the DataSet as an XML file). when the clients connect to the server, the server should send some informations to the client depends… >>> More
Declaring variables with New DataSet vs DataSet

as seen on Stack Overflow - Search for 'Stack Overflow'
What is the impact of creating variables using: Dim ds as New DataSet ds = GetActualData() where GetActualData() also creates a New DataSet and returns it? Does the original empty DataSet that was 'New'ed just get left in the Heap? What if this kind of code was in many places? Would… >>> More
DataSet.Copy vs Dataset.Clone

as seen on Stack Overflow - Search for 'Stack Overflow'
Can someone explain me DataSet.Copy vs Dataset.Clone Also let me know some scenario's where we can use these >>> More

Related posts about Xml

Store XML,update record in XML,retrive a specific record in XML stored on BB device

as seen on Stack Overflow - Search for 'Stack Overflow'
I am writing a blackberry application where i want to store the data returned by a web service in my BB device.Earlier i was going to use SQLite for storing the data in mobile but as i googled and also did programming using SQLite and found that some BB devices dont support SQLite library and fail… >>> More
gwt+xml- can i read through incomplete XML using the GWT XML Parser

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a requirement where a user is typing in XML in a text area, and I want to show the various nodes in a tree...But as the user is typing in the xml, it wont be a complete xml (since he is still typing in the XML)... How do I read an incomplete XML and correctly generate the tree? I understand… >>> More
perl xml parser get xml content within xml

as seen on Stack Overflow - Search for 'Stack Overflow'
How can I use XMLParser to get the item-@url, item-@replace and item-"value inside" for the content as a string of the node where item-@cone="one"? <cstep> <item cone="one" url="http://google.com/{ccc}/cthree" replace="{ccc}"> <itemsub conesub="conesub"> … >>> More
Reading php generated XML in flash?

as seen on Stack Overflow - Search for 'Stack Overflow'
Here is part 1 of our problem (Loading a dynamically generated XML file as PHP in Flash). Now we were able to get Flash to read the XML file, but we can only see the Flash render correctly when tested(test movie) from the actual Flash program. However, when we upload our files online to preview the… >>> More
Announcing RSS feeds of Microsoft All-In-One Code Framework code samples

as seen on Geeks with Blogs - Search for 'Geeks with Blogs'
Today, we are not only announcing Sample Browser v2 CTP, but we are also excited to announce the availability of RSS feeds of All-In-One Code Framework code samples. By using these feeds, you can easily track and download the new code samples. English RSS feeds All code samples: http://support… >>> More