hadoop - Determining the current Kerberos user in an Apache Spark job -

-



i'm running spark jobs on kerberos-enabled cluster (cloudera), , able log kerberos identity of user, given run of job.

(note not identity of local linux user launches job, because use keytab files, jaas.conf files, , call kinit in launch script. can log identity in launch script, since know principal passed kinit along keytab, nice able log within actual spark job itself, if job launched manually, reliably know identity ran under).

some answers suggest following:

import java.security.{accesscontroller,principal} import javax.security.auth.subject  val acc = accesscontroller.getcontext val sub = subject.getsubject(acc) val principals = sub.getprincipals

but returned sub null, not work.

you need @ usergroupinformation class.

to logged-in user, can use:

import org.apache.hadoop.security.usergroupinformation  val user = usergroupinformation.getloginuser  res6: org.apache.hadoop.security.usergroupinformation = user@realm (auth:kerberos)




wiki

Comments

Post a Comment

Popular posts from this blog

elasticsearch - what is the equivalent data type for geo_point in hibernate search? -

-
i using elastic search hibernate search.i want make 1 property data type geo_point ,so can draw tile map using kibana.is there equivalent data type in hibernate search geo_point in elastic search? you can use spatial feature of hibernate search: import org.hibernate.search.annotations.*; @entity @indexed @spatial public class hotel { @latitude double latitude @longitude double longitude // ... } you end geo_point field named location in document. for more information: https://docs.jboss.org/hibernate/stable/search/reference/en-us/html_single/#spatial wiki
Read more

firebase - How to wait value in Ionic 2 -

-
i'm trying wait value may change after execute "this.bookmarlist.take(1).subscribe(..." my problem when run application, execute second if statement "if(found==false)" before execute subscribe. this code may found thing wrong or need add additions solve problem. let loader = this.loadingctrl.create({ content: "", }); let found=false; loader.present().then(()=>{ this.bookmarklist.take(1).subscribe(data=>{ data.foreach(b=>{ if(b.nid==this.appservice.id && b.url==url){ let alert = this.alertctrl.create({ title: 'already bookmarked', subtitle: 'this note image bookmarked', buttons: ['ok'] }); alert.present(); found=true; } }) }) }).then(()=>{ if(found==false){ this.afd.list('/bookmark/').push({ uemail: th...
Read more

Jenkins: find build number for git commit -

-
each commit git repo triggers build of jenkins pipeline. i want retrieve buildnumber of old build commit hash. how can that? i know information exists because can find in ui. some background why want this: when tags commit want create release (by tagging docker image). each build push image containing build number. want find out build number corresponds commit can find image want release. if understand question correctly, first need create git hook trigger new build. part covered in answer how react new tags in git hooks? ', though if using github, bitbucket or gitlab, there may other ways of going it. then when build initiated, there build number provided variable ' build_number ' ,in jenkins. if want include git tag name, can use in script, there seems fews ways: git parameter plugin git tag message plugin typically these plugins create environment variable can consumed scripts. not providing more concrete examples, since not aware of exact ...
Read more