sql - How to optimize the downloading of data to the server in SSIS -

-

good day. need records oracle database database in sql server. data source type (odbc) performed using sql command, taking possible indices according requirement. process runs fine, problem takes long time , need quick. process can not performed lookup, requires merge or merge join, load table oracle sql under conditions.

thank help

check limiting factor. there 3 points check:

  1. remote server slow. source db can run low on memory, read speed or free cpu. substitute query straight select statement no where clause or joins , see if ssis package runs faster.

  2. target db. may have indexes enabled, high write latency on hdd or not enough cpu. run insert target table , see how longer takes.

  3. problem may in middle: transfer between 2 servers. network main bottleneck. ssis hosted on same server sql server? have 2 network connections + possible hardware bottleneck on dedicated ssis machine.

depending on bottleneck there different solutions.

if have network capacity , bottleneck 1 cpu per query on oracle, can partition data horisontally (ids 1 100, 101 200 etc); establish multiple connections oracle , load data in several streams. number of streams 1 less number of cpus on oracle, ssis or sql server (which ever smaller).


Comments

Post a Comment

Popular posts from this blog

How can we post XML strings along with text strings in iOS -

-
nsstring *starcardstr=@"https://starcardsindia.com/test/api/userauthentication"; //nsstring *poststr=[nsstring stringwithformat:@"https://starcardsindia.com/api/otpverification"]; // nsurl *url=[nsurl urlwithstring:poststr]; nsurl *url=[nsurl urlwithstring:starcardstr]; nsmutableurlrequest *request=[[nsmutableurlrequest alloc]init]; [request seturl:[nsurl urlwithstring:starcardstr]]; [request sethttpmethod:@"post"]; nsstring *contenttype = [nsstring stringwithformat:@"text/xml"]; [request addvalue:contenttype forhttpheaderfield: @"content-type"]; nsmutabledata *pbody=[nsmutabledata data]; [pbody appenddata:[[nsstring stringwithformat:@"<xml>"] datausingencoding:nsutf8stringencoding]]; // create post [pbody appenddata: [[nsstring stringwithformat: @"<?xml version=\"1.0\" encoding=\"utf-8\" ?>"] datausingencoding: nsutf8stringencoding]]; //[pbody appenddata:[...
Read more

How to run C# code using mono without Xamarin in Android? -

-
i want create program uses mono runtime run c# code (binary not application). i copied libmono.so unity app , i'm write code using documentation: http://www.mono-project.com/docs/advanced/embedding/ and it's working have problems references can access classes mscorlib.dll , have problems system.reflection.assembly class throwing exception, when print console see: system.missingmethodexception: method not found: 'system.reflection.assembly.op_inequality' can fix it? can use mono runtime in c binary on android? ps. i'm using android tests. edit: found solution loading libraries, need set environment variable mono_path libraries path. but have still problems assembly class. the system.missingmethodexception error have seems .net profile mismatch error, 1 explained here . can use mono runtime in c binary on android? yes, using ndk guess. there alternatives can use instead of rolling own, such xmadevlab .
Read more

c# - cefsharp app remember password option -

-
i embedding webapp using cefsharp working fine. however, when logging app, cef doesn't offer remember username , password when opening app in normal chrome. is there way in cefsharp cef ask remember usernames/password when uses go app, able sign in quicker ? i have tried using command line args e.g. cefsettings cs = new cefsettings(); cs.cefcommandlineargs.add("enable-automatic-password-saving", "enable-automatic-password-saving"); cs.cefcommandlineargs.add("enable-password-save-in-page-navigation", "enable-password-save-in-page-navigation"); cef.initialize(cs); but far, cef has not prompted me save username/password. cefsharp doesn't support remember password prompt. don't believe cef either, though it's worth asking on http://magpcss.org/ceforum/ definitive answer (there's no reference in api current version). i'll point of unless explicitly told cef use in memory cookie store, session cookies ...
Read more