Questions tagged [data-collection]

159 questions
9
votes
4 answers

Detect when app is opened/resumed

I'd like to check-in and checkout a user with the server every time that the app is opened/closed, whether it is launched or resumed from the task drawer. Is there is a way to do this while avoiding having to call a function in each Activity? Thank…
Tom McFarlin
  • 829
  • 1
  • 9
  • 24
7
votes
1 answer

Debugging and tracking Hotjar data

Recently, our company started using Hotjar to collect usage data. As this is my first time using the service, I made some mistakes, which made me search for a method for debugging. After reading the official documentation, forums, stackoverflow, I…
Adam Benedek
  • 592
  • 4
  • 17
7
votes
2 answers

Protection from Web Scraping

I am currently part of a team developing an application which includes a front end client. Through this client we send the user data, each user has a user-id and the client talks to our server through a RESTful API asking the server for data. For…
Benjamin Gruenbaum
  • 270,886
  • 87
  • 504
  • 504
7
votes
2 answers

Middleware to build data-gathering and monitoring for a distributed system

I am currently looking for a good middleware to build a solution to for a monitoring and maintenance system. We are tasked with the challenge to monitor, gather data from and maintain a distributed system consisting of up to 10,000 individual…
6
votes
1 answer

Relational database versus R/Python data frames

I was exposed to the world of tables and data structures in R before the RDBMS systems and other database systems. It is quite elegant in R/Python to create tables and lists from stuctured data (.csv or other formats) and then do data manipulations…
5
votes
2 answers

Where get data to compare cache algorithms

I wan`t to compare cache algorithms like LRU, SLRU, LFU etc on real data. That`s why I need some method to generate real-like data to compare cache algorithms or to get this data from some application.
chinskiy
  • 2,557
  • 4
  • 21
  • 40
5
votes
2 answers

Google Analytics - can it collect form data?

Simple scenario: I have a signup form, with user name, password, email address, may be credit card number. At the bottom of the page, I implement the Google Analytics code. when user clicks submit, it goes to a page wihtout google…
Murvinlai
  • 2,276
  • 6
  • 23
  • 34
3
votes
1 answer

Problem with PDF download that I cannot open

I am working on a script to extract text from law cases using https://case.law/docs/site_features/api. I have created methods for search and create-xlsx, which work well, but I am struggling with the method to open an online pdf link, write (wb) in…
Arno
  • 33
  • 3
3
votes
1 answer

PyCharm: why it collects my personal data

Just installed PyCharm Community that should be free under Apache 2.0 license but can not start the software until I agree to share my personal data including phone number, ip address, tax ID, physical address, etc to Jetbrains and associated…
Andrey Putilov
  • 148
  • 4
  • 13
3
votes
0 answers

How to handle HTTP error 503 when making API calls to process JSON files in R with the jsonlite package?

I'm having problems using the JSONlite package in R to collect Dota2 match data using the Steam API. I am not an experienced developer and really appreciate any help. Thanks! I have created a script in R. When I check the API call using a web…
djnikkei
  • 31
  • 1
3
votes
2 answers

Android – Facebook SDK AppEventsLogger logEvent doesn't work

Googling didn't help me. I'm trying to push data on Facebook dashboard via Facebook app events My code is: AppEventsLogger logger = AppEventsLogger.newLogger(this); logger.activateApp(this, Utility.FACEBOOK_ID); …
Anton Kashpor
  • 1,255
  • 2
  • 18
  • 34
3
votes
0 answers

What is the standard way to implement a clickstream today?

Let us assume we have a website and, for the sake of argument, that the back end is written in Java. Let us also assume that we would like to capture clickstream data for users on our website. We would like to track various things, for example: …
ioreskovic
  • 5,531
  • 5
  • 39
  • 70
3
votes
4 answers

Java - Retrieving data from a website

I'm making an application that recovers lottery numbers and displays them in a window. However I've unsure of how I would recover the data and the numbers from the website: https://www.national-lottery.co.uk/player/p/results.ftl How would you go…
Tim
  • 1,056
  • 4
  • 17
  • 34
2
votes
1 answer

Streaming Google Analytics 4 data to BigQuery causing data collection issues

We have configured a linking between the GA 4 property and GoogleBigQuery via the GA interface (without any additional code). It works fine, we see a migrated data in GBQ tables, but however, we face an issue with how this data is written in those…
2
votes
1 answer

Can someone guide me how to collect a list of url address in the tab using python?

I'm trying to collect a list of "https://..." and hope to store them in csv file. I can do them manually such as use excel, copy the urls from the website of interest and paste them one by one. But it's tedious and definitely would take lot of…
1
2 3
10 11