Slow Update to Remote Database


i'm having trouble finding quick way update on large amount of data to a remote database.

in situation, data taken table, , updated external service (ncoa, corrects address data), , sent in sdf text file. need take data , update orginal table data in sdf file. problem orginal database on remote server, and i'm not allowed import data tempoary table there update join on tempoary table (which quick.)

currently, i'm using c# ado.net connect database, load sdf locally, pull data each record, build update command, , execute each 1 separately. extremely slow (~4 records updated per second), , there can on million records need updated, method not acceptable. have tried pulled multiple update commands in single command object before executing it, doesn't improve speed @ all.

does know how can quicker bulk update remote database this?

thanks,
brian2344

yep - should if create staging table data, bulk insert or bcp staging table, create appropriate indexes on staging table, , update within sql server.  you'll still want batch records - can more 1000 or 10000 records @ time way.  create sproc handle update, , truncate , refill staging table text file.....but again, i'm db guy.  there's nothing wrong doing bcp/bulk insert via ado.net, put entire update proc in sql server.

do need more specific information on of steps?  i'll happy provide - let me know.
aaron alton | thehobt.blogspot.com


SQL Server  >  SQL Server Data Access



Comments

Post a Comment

Popular posts from this blog

Conditional formatting a graph vertical axis in SSRS 2012 charts

Image
hi, i have situation want color label on vertical axis of graph depending on condition. when values positive color black , when negative color red. i tried following condition but not working.   =iif(fields!myfield.value < 0 , "red", "black") i know there few threads mentioning feature not supported in ssrs 2008 wanted know if adddressed in ssrs 2012 or later? thanks , regards, oliver d'mello hi oliver, according description, want use expression specify different color axis labels based on values in chart. as tested in our environment, when apply condition in expression give dynamic color axis labels, color setting applies labels based on condition. issue happens in both sql server 2012 , 2014. please refer screenshots below: in scenario, recommend submit issue microsoft connect @ link https://connect.microsoft.com/sqlserver/feedback . connect site serve connecting point between , microsoft, , large community , microsoft intera
Read more

Register with Power BI failed

hi all, i've running local report server , want configure power bi integration. sign in azure active directory , registering power bi clientapp validated, fails following error: microsoft.reportingservices.wmiprovider.wmiproviderexception: unknown error has occurred in wmi provider. error code 80131500  ---> system.exception: exception of type 'system.exception' thrown.    --- end of inner exception stack trace ---    at microsoft.reportingservices.wmiprovider.rswmiadmin.throwonerror(managementbaseobject mo)    at microsoft.reportingservices.wmiprovider.rswmiadmin.savepowerbiinformation(string clientid, string clientsecret, string appobjectid, string tenantname, string tenantid, string resourceurl, string authurl, string tokenurl, string redirecturls)    at reportservicesconfigui.wmiprovider.rsreportserveradmin.savepowerbiinformation(powerbiappconfiguration appconfig) i tried sql server agent solution  ( https://social.msdn.microsoft.com/forums/en-us/58
Read more

SQL server replication error Cannot find the dbo or user defined function........

hi there, i ran problem while deploying sql 2008 transactional replication between 2 servers lets assume server , b. actually created  both distributor , publisher on server , after created subscriber pointed server b, launch replication monitor , found big red cross. when click on tab "distributor subscriber history" error says "cannot find either column "dbo" or user defined-function or aggregate "dbo.ufnleadingzeros", or name ambiguous". can body regarding issue. regards, ishuv hi, you need compare data , others reseved, index size, unused should not compared. differs. here server - data - 87896 kb server b - data - 78152 kb server data size includes publication tables, can't compare directly. need check article article know exact data size. SQL Server  > 
Read more