r - dplyr filtering with lubridate::hhmm format with minute() -

-



answering question temperature curve in r came across weird behavior of dplyr::filter - lubridate::minute combination.

see test data dta below. dta$time lubridate::hhmm format. 

library(lubridate) library(dplyr)  dta$time <- hm(dta$time)

to rows full hours (i.e. 0 minutes) 1 can subset using lubridate::minute this: 

dta[minute(dta$time) == 0,] #        time    temp1    temp2 # 1        0s 18.62800 18.54458 # 7  1h 0m 0s 18.45733 18.22625 # 13 2h 0m 0s 18.33258 18.04142

however, when using dplyr's filter, this

dta %>% filter(minute(time) == 0) #     time    temp1    temp2 # 1     0s 18.62800 18.54458 # 2 10m 0s 18.45733 18.22625 # 3 20m 0s 18.33258 18.04142

the result not fit expectation. (update: values of temp1 , temp2 correct, time corrupt... @brian btw giving hint. )

additionally warning returned:

warning message: in format.data.frame(x, digits = digits, na.encode = false) : corrupt data frame: columns truncated or padded nas

this reported , somehow solved here, coercion, seems remove fun (and readable) part of lubridate.

question: there way (to date) dplyr::filter lubridate::hhmm(ss) formats without coercing character etc.?

update:

it seems vector created 

minute(dta$time) # [1]  0 10 20 30 40 50  0 10 20 30 40 50  0

looks numeric vector, yet seems have mysterious characteristics.

furthermore, @lyngbakr pointed out comparison == not have usual characteristics "normal" logical vector. 

tst <- minute(dta$time) == 0  dta %>% filter(tst)

will result in same strange time column.

sample data:

dta <- read.table(text = "     time        temp1       temp2                            1  00:00     18.62800    18.54458                            2   00:10     18.60025    18.48283                            3   00:20     18.57250    18.36767                            4   00:30     18.54667    18.36950                            5   00:40     18.51483    18.36550                            6   00:50     18.48325    18.34783                            7   01:00     18.45733    18.22625                            8   01:10     18.43767    18.19067                            9   01:20     18.41583    18.22042                            10  01:30     18.39608    18.21225                            11  01:40     18.37625    18.18658                            12  01:50     18.35633    18.05942                            13  02:00     18.33258    18.04142", header = t)

i don't know why works, does: time column needs of type datetime, not period.

dta %>%    mutate(time = as_datetime(hm(time))) %>%    filter(minute(time) == 0)  
                 time    temp1    temp2 1 1970-01-01 00:00:00 18.62800 18.54458 2 1970-01-01 01:00:00 18.45733 18.22625 3 1970-01-01 02:00:00 18.33258 18.04142

this has side effect of adding time in time column unix epoch, advise including actual date when you're using time-only data.

if minutes elapsed since start of experiment, doesn't matter much, don't have display 1970-01-01 part.





wiki

Comments

Post a Comment

Popular posts from this blog

Asterisk AGI Python Script to Dialplan does not work -

-
i'm stuck project have check database of sip extension incoming caller id , dial sip extension. below receive when run script on asterisk cli. -- registered sip '9125' @ 192.168.1.102:50142 > saved useragent "zoiper rv2.8.40" peer 9125 [2017-08-22 13:53:33] notice[5095]: chan_sip.c:24558 handle_response_peerpoke: peer '9125' reachable. (17ms / 2000ms) == using sip rtp tos bits 184 == using sip rtp cos mark 5 -- executing [0112617769@from-trunk:1] answer("sip/obitrunk1-0000000d", "") in new stack > 0x1ca50d0 -- probation passed - setting rtp source address 192.168.1.98:16834 -- executing [0112617769@from-trunk:2] agi("sip/obitrunk1-0000000d", "test.py") in new stack -- launched agi script /var/lib/asterisk/agi-bin/test.py args: ['/var/lib/asterisk/agi-bin/test.py'] env line: agi_request: test.py env line: agi_channel: sip/obitrunk1-0000000d env line: agi_language: en env line: a...
Read more

python - Read npy file directly from S3 StreamingBody -

-
i have many .npy (numpy) , .json files saved in s3, need download , load these files. for json files downloading files , loading dictionary using following code: obj = s3.object(bucket, key) response = obj.get() body = response['body'].read().decode('utf-8') data = json.loads(body) that way avoid writing .json file disk , reading it. now want same .npy files, equivalent? currently downloading file, saving temp file on disk , loading np.load avoid if possible. following https://stackoverflow.com/a/28196540/3509999 : obj = s3.object(bucket, key) io.bytesio(obj.get()["body"].read()) f: # rewind file f.seek(0) arr = np.load(f) wiki
Read more

kotlin - Out-projected type in generic interface prohibits the use of metod with generic parameter -

-
i start using kotlin , defined interface this: interface aadapter<vh : recyclerview.viewholder> { fun oncreateaviewholder(parent: viewgroup): vh fun onbindaviewholder(v: vh, position: int) } and when try use on code: class klasa ( private val adapter: aadapter<*> ) { fun dosth(){ //... val vh = this.adapter.oncreateaviewholder(parent) //on below line error adapter.onbindaviewholder(v, position) //... } } i error out-projected type 'aadapter<*>' prohibits use of 'public abstract fun onbindaviewholder(v: t, position: int): unit i tied add "in" or "out" definition i'm confused. how allow it. replace aadapter<*> aadapter<recyclerview.viewholder> . class klasa ( private val adapter: aadapter<recyclerview.viewholder> ) { // ... because have declared aadapter has type parameter vh type subclass of recyclerview....
Read more