Issue with NoahMP-4.0.1 Parallel Computing in GRACE TWS DA runs: Vertical Strips in Output

[ThangjamSatrajitSingh]

Hi,
I am Satrajit from the Hydrosense Group at IIT Delhi. We are running GRACE TWS data assimilation (DA) using the NoahMP-4.0.1 model and have encountered an issue with parallel run.

Details:

• In open-loop runs, using multiple processors works without any issues.
• However, during GRACE TWS DA runs with parallel computing in ensemble smoother runmode, the output shows abnormal vertical strips of single pixels.
• The number of vertical strip segments matches the number of processors used along the x-dimension.
• For example: With a 6x6 processor grid (36 processors total), the output is divided into 6 parts, each with vertical single-pixel strips. And with 4x4 processor grid, the output is divided into 4 parts as shown below:

• Also, the issue disappears with a 1x36 processor grid.
• The strips start appearing from April 2002, which coincides with the availability of the first GRACE satellite data.

So, most probably the problem is with how the model handles parallelization across processors, particularly during GRACE TWS DA in the ensemble smoother runmode.

Has anyone else encountered this issue with parallel runs in NoahMP-4.0.1 during GRACE TWS DA runs before?

PS: The LIS executable is compiled from the master version with optimization level = 3.

Thank you!

[dmocko]

Hi @ThangjamSatrajitSingh

Thank you for introducing yourself and for your question.

What version of the LIS code are you using?

Can you please share/attach your LISF/lis/make/configure.lis file as well as your lis.config file?

[ThangjamSatrajitSingh]

Hi @dmocko
Thank you for your response.
I am using the LIS master version. Below is the lis.config file as requested:
configure.lis.zip
Please let me know if you need any additional details.

Best regards,
Thangjam Satrajit Singh