Slow Update to Remote Database


i'm having trouble finding quick way update on large amount of data to a remote database.

in situation, data taken table, , updated external service (ncoa, corrects address data), , sent in sdf text file. need take data , update orginal table data in sdf file. problem orginal database on remote server, and i'm not allowed import data tempoary table there update join on tempoary table (which quick.)

currently, i'm using c# ado.net connect database, load sdf locally, pull data each record, build update command, , execute each 1 separately. extremely slow (~4 records updated per second), , there can on million records need updated, method not acceptable. have tried pulled multiple update commands in single command object before executing it, doesn't improve speed @ all.

does know how can quicker bulk update remote database this?

thanks,
brian2344

yep - should if create staging table data, bulk insert or bcp staging table, create appropriate indexes on staging table, , update within sql server.  you'll still want batch records - can more 1000 or 10000 records @ time way.  create sproc handle update, , truncate , refill staging table text file.....but again, i'm db guy.  there's nothing wrong doing bcp/bulk insert via ado.net, put entire update proc in sql server.

do need more specific information on of steps?  i'll happy provide - let me know.
aaron alton | thehobt.blogspot.com


SQL Server  >  SQL Server Data Access



Comments

Post a Comment

Popular posts from this blog

SQL server replication error Cannot find the dbo or user defined function........

hi there, i ran problem while deploying sql 2008 transactional replication between 2 servers lets assume server , b. actually created  both distributor , publisher on server , after created subscriber pointed server b, launch replication monitor , found big red cross. when click on tab "distributor subscriber history" error says "cannot find either column "dbo" or user defined-function or aggregate "dbo.ufnleadingzeros", or name ambiguous". can body regarding issue. regards, ishuv hi, you need compare data , others reseved, index size, unused should not compared. differs. here server - data - 87896 kb server b - data - 78152 kb server data size includes publication tables, can't compare directly. need check article article know exact data size. SQL Server  >  ...
Read more

BIT Version

  hi,     knows how find out ther bit version in sql  , windows os (32 or 64)   regards, s.balavenkatesh   microsoft sql server 2005 - 9.00.1399.06 (intel x86) oct 14 2005 00:33:37 copyright (c) 1988-2005 microsoft corporation standard edition on windows nt 5.2 (build 3790: service pack 2)     intel x86)   -- says sql server 32 bit   madhu SQL Server  >  SQL Server Tools
Read more

Admin Permissions

hi need create new 'role' following permissions, 1. access sql server logs. 2. access maintenance plans ( can avoid access) 3. access activity monitor 4. normal access product databases , not system db´s need guidance on how it, can point me in right direction please? thanks 1.grant  execute on xp_readerrorlog [domainname\ad user or group]; 2. http://technet.microsoft.com/en-us/library/ms191002.aspx 3.view server state permission 4. make user member of dbo_owner database role. best regards,uri dimant sql server mvp, http://sqlblog.com/blogs/uri_dimant/ ms sql optimization: ms sql development , optimization ms sql consulting: large scale of database , data cleansing remote dba services: improves ms sql database performance sql server integration services: business intelligence SQL Server  >  ...
Read more