Problem with Hadoop Hive Task and Hadoop Pig Task in SSIS for SQL2016


hi,

  i'm testing out new task hadoop ins ssis sql2016. have installed hdinsight emulator , tried execute little pig script. when execute directly @ grunt prompt pig script works expected, if execute hadoop pig script in ssis fails , have following output (remove comment logs name of task):

[remove comment logs] information: schedule hadoop job successfully. job id job_1455103176281_0024
[remove comment logs] information: hadoop job job_1455103176281_0024 status prep
[remove comment logs] information: hadoop job job_1455103176281_0024 status prep
[remove comment logs] information: hadoop job job_1455103176281_0024 status running
[remove comment logs] information: hadoop job job_1455103176281_0024 status succeeded
[remove comment logs] information: hadoop job job_1455103176281_0024 tracking url
[remove comment logs] information: hadoop job job_1455103176281_0024 exit value 255
[remove comment logs] error: hadoop job job_1455103176281_0024 exit value not 0
task remove comment logs failed

likewise if execute hive script in hive prompt everthing works expected, if execute same script hadoop hive task fails following output:

[hadoop hive task] information: schedule hadoop job successfully. job id job_1455103176281_0025
[hadoop hive task] information: hadoop job job_1455103176281_0025 status prep
[hadoop hive task] information: hadoop job job_1455103176281_0025 status prep
[hadoop hive task] information: hadoop job job_1455103176281_0025 status running
[hadoop hive task] information: hadoop job job_1455103176281_0025 status running
[hadoop hive task] information: hadoop job job_1455103176281_0025 status succeeded
[hadoop hive task] information: hadoop job job_1455103176281_0025 tracking url
[hadoop hive task] information: hadoop job job_1455103176281_0025 exit value 403
[hadoop hive task] error: hadoop job job_1455103176281_0025 exit value not 0
task hadoop hive task failed

it looks me hadoop jobs executed successfully, although no data produced , there somehow failure @ tracking url's causing failure (just thought).

has got hadoop task in sql2016 working or can me errors.

i'm using ctp 3.3

thanks lot in advance

marc mertens

hi marc,

a pig task code cannot run hadoop hive task

arthur

myblog

twitter



SQL Server  >  SQL Server Integration Services



Comments

Post a Comment

Popular posts from this blog

SQL server replication error Cannot find the dbo or user defined function........

hi there, i ran problem while deploying sql 2008 transactional replication between 2 servers lets assume server , b. actually created  both distributor , publisher on server , after created subscriber pointed server b, launch replication monitor , found big red cross. when click on tab "distributor subscriber history" error says "cannot find either column "dbo" or user defined-function or aggregate "dbo.ufnleadingzeros", or name ambiguous". can body regarding issue. regards, ishuv hi, you need compare data , others reseved, index size, unused should not compared. differs. here server - data - 87896 kb server b - data - 78152 kb server data size includes publication tables, can't compare directly. need check article article know exact data size. SQL Server  >  ...
Read more

BIT Version

  hi,     knows how find out ther bit version in sql  , windows os (32 or 64)   regards, s.balavenkatesh   microsoft sql server 2005 - 9.00.1399.06 (intel x86) oct 14 2005 00:33:37 copyright (c) 1988-2005 microsoft corporation standard edition on windows nt 5.2 (build 3790: service pack 2)     intel x86)   -- says sql server 32 bit   madhu SQL Server  >  SQL Server Tools
Read more

Admin Permissions

hi need create new 'role' following permissions, 1. access sql server logs. 2. access maintenance plans ( can avoid access) 3. access activity monitor 4. normal access product databases , not system db´s need guidance on how it, can point me in right direction please? thanks 1.grant  execute on xp_readerrorlog [domainname\ad user or group]; 2. http://technet.microsoft.com/en-us/library/ms191002.aspx 3.view server state permission 4. make user member of dbo_owner database role. best regards,uri dimant sql server mvp, http://sqlblog.com/blogs/uri_dimant/ ms sql optimization: ms sql development , optimization ms sql consulting: large scale of database , data cleansing remote dba services: improves ms sql database performance sql server integration services: business intelligence SQL Server  >  ...
Read more