Problem with Hadoop Hive Task and Hadoop Pig Task in SSIS for SQL2016


hi,

  i'm testing out new task hadoop ins ssis sql2016. have installed hdinsight emulator , tried execute little pig script. when execute directly @ grunt prompt pig script works expected, if execute hadoop pig script in ssis fails , have following output (remove comment logs name of task):

[remove comment logs] information: schedule hadoop job successfully. job id job_1455103176281_0024
[remove comment logs] information: hadoop job job_1455103176281_0024 status prep
[remove comment logs] information: hadoop job job_1455103176281_0024 status prep
[remove comment logs] information: hadoop job job_1455103176281_0024 status running
[remove comment logs] information: hadoop job job_1455103176281_0024 status succeeded
[remove comment logs] information: hadoop job job_1455103176281_0024 tracking url
[remove comment logs] information: hadoop job job_1455103176281_0024 exit value 255
[remove comment logs] error: hadoop job job_1455103176281_0024 exit value not 0
task remove comment logs failed

likewise if execute hive script in hive prompt everthing works expected, if execute same script hadoop hive task fails following output:

[hadoop hive task] information: schedule hadoop job successfully. job id job_1455103176281_0025
[hadoop hive task] information: hadoop job job_1455103176281_0025 status prep
[hadoop hive task] information: hadoop job job_1455103176281_0025 status prep
[hadoop hive task] information: hadoop job job_1455103176281_0025 status running
[hadoop hive task] information: hadoop job job_1455103176281_0025 status running
[hadoop hive task] information: hadoop job job_1455103176281_0025 status succeeded
[hadoop hive task] information: hadoop job job_1455103176281_0025 tracking url
[hadoop hive task] information: hadoop job job_1455103176281_0025 exit value 403
[hadoop hive task] error: hadoop job job_1455103176281_0025 exit value not 0
task hadoop hive task failed

it looks me hadoop jobs executed successfully, although no data produced , there somehow failure @ tracking url's causing failure (just thought).

has got hadoop task in sql2016 working or can me errors.

i'm using ctp 3.3

thanks lot in advance

marc mertens

hi marc,

a pig task code cannot run hadoop hive task

arthur

myblog

twitter



SQL Server  >  SQL Server Integration Services



Comments

Post a Comment

Popular posts from this blog

Conditional formatting a graph vertical axis in SSRS 2012 charts

Image
hi, i have situation want color label on vertical axis of graph depending on condition. when values positive color black , when negative color red. i tried following condition but not working.   =iif(fields!myfield.value < 0 , "red", "black") i know there few threads mentioning feature not supported in ssrs 2008 wanted know if adddressed in ssrs 2012 or later? thanks , regards, oliver d'mello hi oliver, according description, want use expression specify different color axis labels based on values in chart. as tested in our environment, when apply condition in expression give dynamic color axis labels, color setting applies labels based on condition. issue happens in both sql server 2012 , 2014. please refer screenshots below: in scenario, recommend submit issue microsoft connect @ link https://connect.microsoft.com/sqlserver/feedback . connect site serve connecting point between , microsoft, , large community , microsoft intera
Read more

Register with Power BI failed

hi all, i've running local report server , want configure power bi integration. sign in azure active directory , registering power bi clientapp validated, fails following error: microsoft.reportingservices.wmiprovider.wmiproviderexception: unknown error has occurred in wmi provider. error code 80131500  ---> system.exception: exception of type 'system.exception' thrown.    --- end of inner exception stack trace ---    at microsoft.reportingservices.wmiprovider.rswmiadmin.throwonerror(managementbaseobject mo)    at microsoft.reportingservices.wmiprovider.rswmiadmin.savepowerbiinformation(string clientid, string clientsecret, string appobjectid, string tenantname, string tenantid, string resourceurl, string authurl, string tokenurl, string redirecturls)    at reportservicesconfigui.wmiprovider.rsreportserveradmin.savepowerbiinformation(powerbiappconfiguration appconfig) i tried sql server agent solution  ( https://social.msdn.microsoft.com/forums/en-us/58
Read more

SQL server replication error Cannot find the dbo or user defined function........

hi there, i ran problem while deploying sql 2008 transactional replication between 2 servers lets assume server , b. actually created  both distributor , publisher on server , after created subscriber pointed server b, launch replication monitor , found big red cross. when click on tab "distributor subscriber history" error says "cannot find either column "dbo" or user defined-function or aggregate "dbo.ufnleadingzeros", or name ambiguous". can body regarding issue. regards, ishuv hi, you need compare data , others reseved, index size, unused should not compared. differs. here server - data - 87896 kb server b - data - 78152 kb server data size includes publication tables, can't compare directly. need check article article know exact data size. SQL Server  > 
Read more