Stack Overflow
Stack Overflow

Questions tagged [amazon-comprehend]

Amazon Comprehend uses natural language processing (NLP) to extract insights about the content of documents. Amazon Comprehend processes any text file in UTF-8 format. It develops insights by recognizing the entities, key phrases, language, sentiments, and other common elements in a document. Use Amazon Comprehend to create new products based on understanding the structure of documents.

See: What Is Amazon Comprehend?

70 questions
7
votes
2 answers

AWS IAM Comprehend Issue

I am running a lambda which will automatically trigger a comprehend job through the use of boto3. However, for some reason my IAM is not working! I have the following permissions on my role for this job: IAMFullAccess AmazonS3FullAccess …
Owen Murray
  • 135
  • 1
  • 8
4
votes
2 answers

IAM Roles for Sagemaker?

I'm trying to get AWS SageMaker to call AWS Comprehend. I'm getting this message in SageMaker: ClientError: An error occurred (AccessDeniedException) when calling the StartTopicsDetectionJob operation: User: …
VikR
  • 4,818
  • 8
  • 51
  • 96
3
votes
2 answers

AWS Comprehend + Pyspark UDF = Error: can't pickle SSLContext objects

When applying a Pyspark UDF that calls an AWS API, I get the error PicklingError: Could not serialize object: TypeError: can't pickle SSLContext objects The code is import pyspark.sql.functions as sqlf import boto3 comprehend =…
Rafael Ferro
  • 371
  • 3
  • 11
3
votes
0 answers

Classification Algorithm in AWS Comprehend for Sentiment Analyis

Can anyone please tell which classification algorithms are used in AWS Comprehend for Sentiment analysis ? Don't know if AWS uses Naive Bayes, Random Forest, Boosted trees or any other combinations of classifiers for sentiment analysis. Thanks for …
dossani
  • 1,892
  • 3
  • 14
  • 23
2
votes
2 answers

IAM Permissions Errors When Using boto3 for AWS Comprehend

I'm playing around with the command line to run some sentiment analysis through aws and am running into some IAM issues. When running the "detect_dominant_language" function, I'm hitting NotAuthorizedExceptions despite having the policy in place to…
Okeefe Niemann
  • 91
  • 4
2
votes
1 answer

Getting top 3 languages used in text using AWS comprehend

I am trying to auto-detect languages used from texts using AWS Comprehend service. Using boto.detect_dominant_language we only get the top dominating language in the text. Is there a way to get the top 2-3 dominant languages in text for AWS…
UnbreakableMystic
  • 166
  • 3
  • 8
2
votes
2 answers

TextSizeLimitExceededException when calling the DetectPiiEntities operation

I am using aws comprehend for PII redaction, Idea is to detect entities and then redact PII from it. Now the problem is this API has a Input text size limit. How can I increase the limit ?? Maybe to 1 MB ?? Or is there any other way to detect…
Kush Verma
  • 35
  • 1
  • 7
2
votes
2 answers

Parse medical tests and extract tables and key values using Python and AWS?

I want to load a medical test to S3, analyse it with AWS Textract, extract tables and send to AWS Comprehend Medical. For some reason it takes around 6-8 seconds to run. Here is what I have done so far and will appreciate your advise or maybe there…
SteveS
  • 3,789
  • 5
  • 30
  • 64
2
votes
3 answers

What is the "DataAccessRoleArn" for Comprehend in boto 3?

I am using boto3's interface for AWS Comprehend for sentiment analysis. I have an issue with the 'DataAccessRoleArn' parameter. What kind of value is inserted in this? I am requesting for the format of it or some sample.
ANKIT BISHT
  • 47
  • 8
2
votes
1 answer

How Do You Filter Documents by Size Before Sending to AWS Comprehend via boto3?

I'm currently attempting to use the boto3 library to perform batch sentiment analysis on a collection of documents with AWS' Comprehend service. The service has some limitations in document size (documents cannot exceed 5000 bytes); therefore, I'm…
Jacob Turpin
  • 190
  • 2
  • 14
2
votes
1 answer

Creating Client for Amazon Comprehend with AWS for PHP

I recently updated from version 1 of the AWS SDK for PHP to version 3 of the AWS SDK so that I could start testing scripts using the Comprehend and Textract applications. I was able to connect through version 3 and utilize S3 using the "new…
user1120540
  • 121
  • 1
  • 8
2
votes
0 answers

AWS Medical Comprehend customization

I am currently using AWS Medical Comprehend to extract data from Dr's dictated text. I am trying to extract data to set it into structured form. AWS Medical comprehend is working good at certain level but not extracting all the proper meanings as…
Ketan Bhavsar
  • 5,338
  • 9
  • 38
  • 69
2
votes
1 answer

What are the correct AssumeRolePolicyDocument and PolicyDocument for Amazon Comprehend

I have the following AssumeRolePolicyDocument: { "Version": "2012-10-17", "Statement": { "Effect": "Allow", …
iirekm
  • 8,890
  • 5
  • 36
  • 46
1
vote
0 answers

How to use an AWS Comprehend Custom Classifier Model with REST API?

Can someone let me know what's the easiest way to use the an AWS Comprehend Custom Classifier Model for real-time analysis through a single API call? I've built a model myself and I'd like to use it through a simple API call instead of using…
Keith
  • 11
  • 1
1
vote
1 answer

Issues with my iam role when using AWS lambda to trigger an async amazon Comprehend job

I am currently using AWS lambda to trigger an asynch Amazon Comprehend job. The data I am using is stored in an input folder in a S3 bucket, and I am trying to output the file in that same bucket, in an output folder. The roles I have for this job…
bendan
  • 11
  • 2
1
2 3 4 5