Skip to content

error/crash for multisample merge across 98 samples #493

Open
@apsteinberg

Description

@apsteinberg

Hello!

Thanks again for building this very useful tool. I'm having an issue that appears to be related to issue #437. When I try to perform a multisample merge across 98 samples using pre-calculated read classes, I receive the following error:

--- Start extending annotations ---
combing spliced feature tibble objects across all samples in 426.6 mins.
Error in reducer$value.cache[[as.character(idx)]] <- values : 
  wrong args for environment subassignment
Calls: bambu ... .bploop_impl -> .collect_result -> .reducer_add -> .reducer_add
In addition: Warning message:
In parallel::mccollect(wait = FALSE, timeout = 1) :
  1 parallel job did not deliver a result
Execution halted
Error while shutting down parallel: unable to terminate some child processes

I can attach the full log as well. I'm using this script to run bambu. Where the call to Bambu looks like:

transcript_assembly.R \
    --rds=293ff57d4d_293ff57d4d.rds,297179d67_297179d67.rds,2927c8cacf_2927c8cacf.rds,2914aed833_2914aed833.rds,2871ce02c3_2871ce02c3.rds,289d1e19e_289d1e19e.rds,296d362f7f_296d362f7f.rds,296f1c9f05_296f1c9f05.rds,275aaa128d_275aaa128d.rds,275685f9f_275685f9f.rds,2979420730_2979420730.rds,2858272176_2858272176.rds,2910b07682_2910b07682.rds,29511fd2a3_29511fd2a3.rds,29595986fb_29595986fb.rds,272f08febe_272f08febe.rds,295e79b274_295e79b274.rds,27691ac39b_27691ac39b.rds,296163a6ef_296163a6ef.rds,281295d9ba_281295d9ba.rds,2918fa4deb_2918fa4deb.rds,28dc5c7af_28dc5c7af.rds,2853522b9a_2853522b9a.rds,2822ae15eb_2822ae15eb.rds,2874e97aba_2874e97aba.rds,291c4e96_291c4e96.rds,295fc4a06f_295fc4a06f.rds,295b0f9002_295b0f9002.rds,2957deb126_2957deb126.rds,2830bcb18e_2830bcb18e.rds,291f60f666_291f60f666.rds,2917ce0264_2917ce0264.rds,275066ff9c_275066ff9c.rds,2946da569b_2946da569b.rds,29b18c084_29b18c084.rds,29203af3ae_29203af3ae.rds,292ac13256_292ac13256.rds,296113ce54_296113ce54.rds,291a434017_291a434017.rds,293225cf7d_293225cf7d.rds,299d9091e_299d9091e.rds,2910bcd898_2910bcd898.rds,293bd94d4b_293bd94d4b.rds,2977841148_2977841148.rds,2929a50622_2929a50622.rds,292361bb72_292361bb72.rds,283a3712f8_283a3712f8.rds,2936a2ac0f_2936a2ac0f.rds,2932f79e5d_2932f79e5d.rds,295ce15443_295ce15443.rds,292d39a61c_292d39a61c.rds,2979aa1901_2979aa1901.rds,282b092165_282b092165.rds,29383c858b_29383c858b.rds,297476bbed_297476bbed.rds,271a67b5a5_271a67b5a5.rds,295cdcf8bb_295cdcf8bb.rds,282ec9a2d5_282ec9a2d5.rds,28cc0cd48_28cc0cd48.rds,2d6a339476_2d6a339476.rds,2955510ecc_2955510ecc.rds,2948427518_2948427518.rds,29bbbf521_29bbbf521.rds,2863597caa_2863597caa.rds,28ea93ef0_28ea93ef0.rds,2916427bd3_2916427bd3.rds,2979c4b878_2979c4b878.rds,2835a78ab0_2835a78ab0.rds,29adccd8e_29adccd8e.rds,29730b56fd_29730b56fd.rds,2929d7119e_2929d7119e.rds,2976466bee_2976466bee.rds,28561c132f_28561c132f.rds,29234b4c7c_29234b4c7c.rds,275df19334_275df19334.rds,2934f262c8_2934f262c8.rds,293b2ab9b8_293b2ab9b8.rds,297a87e8f1_297a87e8f1.rds,292b53d83b_292b53d83b.rds,294cfe0ee4_294cfe0ee4.rds,298ec2169_298ec2169.rds,2928f2a5a9_2928f2a5a9.rds,296ba13665_296ba13665.rds,284c302704_284c302704.rds,2973b6fb76_2973b6fb76.rds,29182e59dd_29182e59dd.rds,296ec55b7f_296ec55b7f.rds,295cfd1097_295cfd1097.rds,295946be1e_295946be1e.rds,296c95f0bd_296c95f0bd.rds,274cdb35ee_274cdb35ee.rds,29726ae120_29726ae120.rds,297b3af8ce_297b3af8ce.rds,2933b5e152_2933b5e152.rds,297e430703_297e430703.rds \
    --yieldsize=NULL \
    --ref_genome=GRCh38.primary_assembly.genome.fa \
    --ref_gtf=gencode.v45.primary_assembly.annotation.gtf \
    --ncore=20 \
     \
    --quant=FALSE --lowMemory=FALSE 2>&1 | tee bambu_assembly.log

It works fine on 10 samples, but when I scale up I get this issue. Any suggestions would be much appreciated. I am using bambu 3.10.0 here.

Thanks,
Asher

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions