# CUDA Error #700 Random Encounter

**URL:** <https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920>\
**Category:** User discussions\
**Tags:** gpu\
**Created:** [April 18, 2024, 4:35pm UTC](https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920 "2024-04-18T16:35:41Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![dmorse](https://avatars.discourse-cdn.com/v4/letter/d/c89c15/32.png) [@dmorse](https://gromacs.bioexcel.eu/u/dmorse)\
**Post date:** [April 18, 2024, 4:35pm UTC](https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920/1 "2024-04-18T16:35:41Z")

</div>

GROMACS version: 2024.1  
GROMACS modification: No  
I am trying to implement a GPU driven parallelization of Gromacs in a cloud compute environment using an NVIDIA architecture and I randomly encounter CUDA Error #700 (Or else some other similar data leakage error), the machine type is very large with over 60 gbs of available memory, so I am at a loss for how to approach the problem. My CUDA version is 12.4 and I downloaded using the methodology provided by NVIDIA: [CUDA Toolkit 12.4 Update 1 Downloads | NVIDIA Developer](https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&Distribution=Ubuntu&target_version=22.04&target_type=deb_local)

Any advice?

-Best

---

<div class="post-metadata">

**Author:** ![MagnusL](https://dub1.discourse-cdn.com/flex017/user_avatar/gromacs.bioexcel.eu/magnusl/32/2380_2.png) [@MagnusL](https://gromacs.bioexcel.eu/u/MagnusL)\
**Post date:** [April 18, 2024, 7:28pm UTC](https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920/2 "2024-04-18T19:28:54Z")

</div>

Do you get any messages, warnings or errors before the crash?

---

<div class="post-metadata">

**Author:** ![dmorse](https://avatars.discourse-cdn.com/v4/letter/d/c89c15/32.png) [@dmorse](https://gromacs.bioexcel.eu/u/dmorse)\
**Post date:** [April 18, 2024, 8:12pm UTC](https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920/3 "2024-04-18T20:12:14Z")

</div>

Yes, common warnings are: “You are using Ewald Statistics in a system with net charge…” (which I am ignoring as the net charge is below the float error cutoff), “The Berendsen barostat does not generate any strictly correct ensemble, and should not be used for new production simulations (in our opinion). We recommend using the C-rescale barostat instead.” (which I can switch in future), and “You are using soft-core interactions while the Van der Waals interactions  
are not decoupled (note that the sc-coul option is only active when using  
lambda states). Although this will not lead to errors, you will need much  
more sampling than without soft-core interactions. Consider using  
sc-alpha=0.” (which I have implemented to correct for near atom-atom inf errors), but these warnings do not always cause the CUDA #700 illegal memory error, which is why I did not suspect them as causal. The error is sporadic, hence my confusion.

---

<div class="post-metadata">

**Author:** ![MagnusL](https://dub1.discourse-cdn.com/flex017/user_avatar/gromacs.bioexcel.eu/magnusl/32/2380_2.png) [@MagnusL](https://gromacs.bioexcel.eu/u/MagnusL)\
**Post date:** [April 19, 2024, 1:25pm UTC](https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920/4 "2024-04-19T13:25:37Z")

</div>

Nothing about LINCS or pressure coupling during the simulations?

---

<div class="post-metadata">

**Author:** ![dmorse](https://avatars.discourse-cdn.com/v4/letter/d/c89c15/32.png) [@dmorse](https://gromacs.bioexcel.eu/u/dmorse)\
**Post date:** [April 20, 2024, 12:08am UTC](https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920/5 "2024-04-20T00:08:48Z")

</div>

Not that I have seen so far, the error is always related to “illegal memory access” or “freeing of device buffer failed” , would recompiling with double precision help you think?

---

<div class="post-metadata">

**Author:** ![MagnusL](https://dub1.discourse-cdn.com/flex017/user_avatar/gromacs.bioexcel.eu/magnusl/32/2380_2.png) [@MagnusL](https://gromacs.bioexcel.eu/u/MagnusL)\
**Post date:** [April 22, 2024, 6:28am UTC](https://gromacs.bioexcel.eu/t/cuda-error-700-random-encounter/8920/6 "2024-04-22T06:28:00Z")

</div>

No, I don’t think compiling with double precision would help.
