Questions tagged [data-handling]
60 questions
3
votes
1 answer
Get the row and column for empty cell using pandas
I am trying to fetch xls file which contains empty cells. I need to validate the xls file using pandas to get row and column position
Expected output:
The row 2, col 2 has empty value [OR]
Tenant ID is not found for Account1
sangeeth kumar
- 319
- 2
- 7
- 23
2
votes
2 answers
Handling data containing comma in a CSV file
I have a CSV File that I am trying to read from Amazon S3 in Mosaic Decisions. This file contains an Address column in which the data itself contains a comma.
Example data in the file is shown below:
Address
sl,name,address
1,Ratan Kumar,FlatNo…
V Ruvesh
- 281
- 1
- 7
2
votes
2 answers
How to groupby and pivot a dataframe with non-numeric values
I'm using Python, and I have a dataset of 6 columns, R, Rc, J, T, Ca and Cb. I need to "aggregate" on the columns "R" then "J", so that for each R, each row is a unique "J". Rc is a characteristic of R. Ca and Cb are characteristics of T. It will…
nielsen
- 383
- 1
- 6
2
votes
1 answer
Tensorflow Dataset using many compressed numpy files
I have a large dataset that I would like to use for training in Tensorflow.
The data is stored in compressed numpy format (using numpy.savez_compressed). There are variable numbers of images per file due to the way they are produced.
Currently I…
Taylor Childers
- 363
- 1
- 6
- 14
2
votes
2 answers
it it possible to make a function return true, false or a list of objects?
Introduction to the program
I'm working on a program which stores data like the following:
- Facts: A combination of a list of properties (or just one) and a true/false value(called the "truth" value). For example:
parent('John' , 'John jr') ,…
BRHSM
- 854
- 3
- 13
- 48
2
votes
1 answer
C# Adding points to Chart in realtime
I have got an question about adding points to charts.
My windows forms application is using a thread to get the Y value from another server. Every 500ms I get a new value(string) which should be added as a point, but I have no idea how to do that.…
Tim B.
- 88
- 2
- 11
2
votes
0 answers
Efficiently removing calibration rolls and replacing them with NaN's
Here is an image that represents Magnetic Field Data that, near the y=0 axis, the data varies as it should.
However, there are clear occurrences in which the varied data transitions into oscillations that easily stand out. These large and…
M. Cuesta
- 37
- 1
1
vote
0 answers
xarray .where() function is too slow over datasets
I am using .where() function to select time and certain criteria in xarray dataset.
import numpy as np
import xarray as xr
ds1 = xr.open_dataset('COD.nc')
ds2 = xr.open_dataset('CDNC.nc')
ds3 = xr.open_dataset('LWP.nc')
ds4 =…
HARSHBARDHAN KUMAR
- 45
- 1
- 8
1
vote
0 answers
Numpy arrays best way to handle data
I have a set of files for different temperatures and have been having issues with how to store the data I need in NumPy arrays. Let's say I have a range of temperatures temperatures = [8,10,12,...]
and need to store each file's first and second…
valit
- 41
- 4
1
vote
2 answers
csv file data appending using python
I've been trying to append certain data from input.csv to output.csv using python.
My code is as under:
import csv
from csv import writer
from csv import reader
csvPath = r'C:\Users\Nitin…
Nitin Kumar
- 45
- 9
1
vote
2 answers
I am trying to create a specific html structure using javasacript dyanamically, but don't know how to do it
I fetching some data with api and want o use them and show them on my HTML page using pure javascript.
My current HTML:
My expected structure to use API data:
user17504907
1
vote
0 answers
Why xml file 'text string' looks encoded after writing with python?
I tried to open XML with notepad, word-pad and notepad++ but it looks encoded into some kind of hashtag strings. But it shows actual data when open with almost any browser like edge, Firefox, explorer. I don't know where i goes wrong. Here is the…
Code Logic
- 11
- 1
1
vote
1 answer
How to group months column in a data frame in R
I have a data frame in the following fashion :
Year <- 1948:2017
Jan<- rnorm(70)
Feb<- rnorm(70)
Mar<- rnorm(70)
Apr<- rnorm(70)
May<- rnorm(70)
Jun<- rnorm(70)
Jul<- rnorm(70)
Aug<- rnorm(70)
Sep<- rnorm(70)
Oct<- rnorm(70)
Nov<- rnorm(70)
Dec<-…
Sayantan4796
- 169
- 1
- 10
1
vote
2 answers
Multiplying columns from different dataframes with different lengths and two conditions in R
I have two data frames with different lengths. I want to mutate the columns in data frame df with the multiplication of CAP * currency and Go * currency from df_cur. This should be done with the conditions that country and Year must be the same for…
Panagiotis Zontiros
- 23
- 4
1
vote
1 answer
