#StackBounty: #python-3.x #hbase #thrift #happybase #hdp unable to upload pdf files of size more than 10MB in Hbase via python happybas…

Bounty: 50

We are using HDP 3. We are trying to insert PDF files in one of the columns of a particular column family in Hbase table. Developing environment is python 3.6 and the hbase connector is happybase 1.1.0.

We are unable to upload any PDF file greater than 10 MB in hbase.

In hbase we have set the parameters as follows:
enter image description here

enter image description here

We get the following error:

IOError(message=b’org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException:
Failed 1 action: org.apache.hadoop.hbase.DoNotRetryIOException: Cell
with size 80941994 exceeds limit of 10485760 bytesntat
org.apache.hadoop.hbase.regionserver.RSRpcServices.checkCellSizeLimit(RSRpcServices.java:937)ntat
org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:1010)ntat
org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicBatchOp(RSRpcServices.java:959)ntat
org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:922)ntat
org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2683)ntat
org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42014)ntat
org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409)ntat
org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131)ntat
org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324)ntat


Get this bounty!!!

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.