ARM64 compilation errors

[hedgehog-fog]

Hello, I've been using @tharman-git 's recent helpful thread to work on building Visit for another ARM64 system, based on an Ampere Altra (Neoverse N1) SOC, on Ubuntu 22.04.4 (Server), and have successfully built Visit but then run into a problem:

After successfully building visit, I first deleted an old, incompatible version of visit:
$ sudo rm -rf /usr/local/visit
Then I ran the installation script (noting the name of the .tgz file in the build_visit folder is visit3_4_1.linux-intel.tar.gz):
$ sudo ./visit-install 3.4.1 linux-intel /usr/local/visit
Then I ran visit
$ which visit
$ /usr/local/visit/bin/visit
$ visit
This loaded the splash screen but then crashed with this message:
Running: gui3.4.1
Running: viewer3.4.1 -geometry 1560x1080+360+0 -borders 26,4,4,4 -shift 0,0 -preshift 4,26 -defer -host 127.0.0.1 -port 5600
Running: mdserver3.4.1 -host 127.0.0.1 -port 5601
Unable to find target for this triple (no targets are registered)
VisIt's viewer exited abnormally! Aborting the Graphical User Interface. VisIt's developers may be reached via our GitHub discussions, https://github.com/visit-dav/visit/discussions

If I run with this flag it runs fine, but there is of course no display window:
$ visit -nowin
I'm a novice at building software, and I would say at intermediate skill level at linux adminstration. Any idea what I should try next? Reading around online there are references to LLVM, but i'm not sure how to incorporate them into my workflow.

Thanks so much for your help!

Here's my workflow:

Downloaded the 3.4.1 build script and changed these lines per @tharman-git's other discussion threads:
21388: CFLAGS="-std=c++11 $CFLAGS $C_OPT_FLAGS -headerpad_max_install_names" CXXFLAGS="-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS"
21409: CFLAGS="-std=c++11 $CFLAGS $C_OPT_FLAGS" CXXFLAGS="-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS"
Manually downloaded some required source files to speed things up:
$ wget https://www.vtk.org/files/release/9.2/VTK-9.2.6.tar.gz
$ wget https://archive.mesa3d.org/older-versions/17.x/mesa-17.3.9.tar.xz
$ wget https://www.python.org/ftp/python/3.9.18/Python-3.9.18.tgz
$ wget https://download.qt.io/archive/qt/6.4/6.4.2/submodules/qtbase-everywhere-src-6.4.2.tar.xz
$ wget https://github.com/visit-dav/visit/releases/download/v3.4.1/visit3.4.1.tar.gz
Following this thread, I found that this library was missing on my system: xcb-proto
Then I cleaned up my build folders and ran the build script:
$ cd build_visit
$ find . -maxdepth 1 -type d -exec /bin/rm -rf {} ;
$ ./build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --system-cmake --qt6 --vtk9 --visit --makeflags -j20
Got this error:
Building UINTAH (~10 minutes)
For Linux builds the PAR_COMPILER, PAR_COMPILER_CXX, and PAR_INCLUDE environment variables must be set.
PAR_INCLUDE should be of the form "-I/path/to/mpi/include"
Added this line to my ~/.bashrc and opened a new terminal:
export PAR_INCLUDE="-I$OPENMPI_ROOT"/include
Then I cleaned up my build folders again and re-ran the build script:
$ cd build_visit
$ find . -maxdepth 1 -type d -exec /bin/rm -rf {} ;
.$ /build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --system-cmake --qt6 --vtk9 --visit --makeflags -j20
Received this error:
CMake Error at CMakeLists.txt:569 (cmake_minimum_required):
CMake 3.24 or higher is required. You are running version 3.22.1
I tried adding --cmake to the build_visit flags:
$ cd ~/repos/build_visit;
$ find . -maxdepth 1 -type d -exec /bin/rm -rf {} ;
$ ./build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --system-cmake --qt6 --vtk9 --visit --makeflags -j20 --cmake
This failed again due to having the wrong cmake version (same error). So I tried manually installing a newer cmake version:
$ sudo apt-fast remove cmake;
$ wget https://github.com/Kitware/CMake/releases/download/v3.30.0-rc3/cmake-3.30.0-rc3-linux-aarch64.sh;
$ sudo mv cmake-3.30.0-rc3-linux-aarch64.sh /opt/.;
$ chmod +x /opt/cmake-3.30.0-rc3-linux-aarch64.sh;
$ cd /opt;
$ sudo bash /opt/cmake-3.30.0-rc3-linux-aarch64.sh;
$ sudo ln -s /opt/cmake-3.30.0-rc3-linux-aarch64.sh/bin/* /usr/local/bin;
$ PATH=$PATH:/opt/cmake-3.30.0-rc3-linux-aarch64/bin;
Then cleaned up and re-ran the build script again, without the --cmake flag:
$ cd ~/repos/build_visit;
$ find . -maxdepth 1 -type d -exec /bin/rm -rf {} ;
$ ./build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --system-cmake --qt6 --vtk9 --visit --makeflags -j20
It compiled successfully
However, I did notice in the build_visit log these lines at the end:
Symlinking current to 3.4.1
CMake Error: failed to create symbolic link '/usr/local/current': Permission denied
CPack: Create package
CPack: - package: ~/repos/build_visit/visit3.4.1/build/visit3_4_1.linux-intel.tar.gz generated.
Deleted an old, incompatible version of visit that I had installed before:
$ sudo rm -rf /usr/local/visit
Ran the installation script (noting the name of the .tgz file in the build_visit folder is visit3_4_1.linux-intel.tar.gz):
$ sudo ./visit-install 3.4.1 linux-intel /usr/local/visit
Then I ran visit
$ which visit
$ /usr/local/visit/bin/visit
$ visit
This loaded the splash screen but then crashed with this message:
Unable to find target for this triple (no targets are registered)
If I run with this flag it runs fine, but there is of course no display window:
$ visit -nowin
I tried re-building without the --system-cmake option:
find . -maxdepth 1 -type d -exec /bin/rm -rf {} ;
$ ./build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --qt6 --vtk9 --visit --makeflags -j20
Successfully built again
Deleted the previously installed version of visit3_4_1.linux-intel.tar.gz
$ sudo rm -rf /usr/local/visit
Ran the installation script with the newly generated visit3_4_1.linux-intel.tar.gz:
$ sudo ./visit-install 3.4.1 linux-intel /usr/local/visit
Then I ran visit again
$ which visit
$ /usr/local/visit/bin/visit
$ visit
Again, this loaded the splash screen but then crashed with this message:
Unable to find target for this triple (no targets are registered)

[hedgehog-fog]

Hello all, I also tried not manually downloading the source archives, and allowing visit to build cmake itself.

So first I cleaned up the manually installed cmake in /opt
$ sudo rm -rf /opt/cmake*
And reinstalled the package manager verison of cmake
$ sudo apt-fast install cmake
I'll start with a fresh folder:
$ sudo rm ~/repos/build_visit/*
$ cd ~/repos/build_visit
$ wget https://github.com/visit-dav/visit/releases/download/v3.4.1/build_visit3_4_1
$ chmod +x build_visit3_4_1
Made sure to edit the visit installer per @tharman-git :
$ nano build_visit3_4_1
Changed these lines:
21388: CFLAGS="-std=c++11 $CFLAGS $C_OPT_FLAGS -headerpad_max_install_names" CXXFLAGS="-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS"
21409: CFLAGS="-std=c++11 $CFLAGS $C_OPT_FLAGS" CXXFLAGS="-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS"
Then I ran build_visit with the --cmake flag to get visit to download its own version of cmake
$ ./build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --cmake --qt6 --vtk9 --visit --makeflags -j20;
It downloaded cmake 3.24.3
Built successfully!
Ran the installer
$ sudo ./visit-install 3.4.1 linux-intel /usr/local/visit
Ran visit
$ cd /usr/local/visit/bin
$ ./visit
Generated the same error:
Running: gui3.4.1
Running: viewer3.4.1 -geometry 1560x1080+360+0 -borders 26,4,4,4 -shift 0,0 -preshift 4,26 -defer -host 127.0.0.1 -port 5600
Running: mdserver3.4.1 -host 127.0.0.1 -port 5601
Unable to find target for this triple (no targets are registered)
VisIt's viewer exited abnormally! Aborting the Graphical User Interface. VisIt's developers may be reached via our GitHub discussions, https://github.com/visit-dav/visit/discussions

[JustinPrivitera]

Any chance you could run ./visit -debug 5 and see if VisIt survives long enough to produce debug logs? They will have the .vlog extension. You can attach them here if successful and we can take a look.

[hedgehog-fog]

Hi sure thing here you go, thanks for having a look!
visit-logs-20240807.tar.gz

[JustinPrivitera]

All it looks like to me is that the viewer is hitting a segfault, which tanks the other VisIt components. It looks like you've tried pretty extensively to build VisIt. I'm not sure why the viewer is crashing. I wonder if other @visit-dav/visit-developers might have thoughts?

[biagas]

Based on this error message: Unable to find target for this triple (no targets are registered)
I found this thread:
https://discourse.llvm.org/t/cant-select-target-for-triple/66633

Which makes me think that perhaps -DLLVM_TARGETS_TO_BUILD:STRING=host should be used instead of the current attempts to guess the proper string to pass for this argument.

You can search for LLVM_TARGETS_TO_BUILD in the build_visit script and modify as suggested and see if that helps.
Will probably need to clean out LLVM, Mesa, Qt, VTK builds, or start again from scratch.

[hedgehog-fog]

Thank you very much for the kind suggestion. I tried this, in conjunction with the recommended changes to the compile flags for Uintah by @tharman-git, however now the Uintah build fails. My log file can be found here:
build_visit3_4_1_log-20240820-1249.tar.gz

Here were the steps I followed on my ARM64 machine running Ubuntu 22.04 (the same system with libraries installed as described here: #19607)

• Started with a fresh folder:
  $ mkdir ~/repos/build_visit-20240820
  $ cd ~/repos/build_visit-20240820
  $ wget https://github.com/visit-dav/visit/releases/download/v3.4.1/build_visit3_4_1
  $ chmod +x build_visit3_4_1

• Edited the build_visit script:
  nano build_visit3_4_1

  • Changed these lines for visit compilation:
    10808: llvm_opts="${llvm_opts} -DLLVM_TARGETS_TO_BUILD:STRING=host"
    10810: llvm_opts="${llvm_opts} -DLLVM_TARGETS_TO_BUILD:STRING=host"
  • Changed these lines for Uintah compilation:
    21388: CFLAGS="-std=c++11 $CFLAGS $C_OPT_FLAGS -headerpad_max_install_names" CXXFLAGS="-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS"
    21409: CFLAGS="-std=c++11 $CFLAGS $C_OPT_FLAGS" CXXFLAGS="-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS" \

• Then I ran the script using the --cmake flag so that visit downloads its own version of cmake
  $ cd ~/repos/build_visit-20240820;
  $ find . -maxdepth 1 -type d -exec /bin/rm -rf {} ;
  $ ./build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --cmake --qt6 --vtk9 --visit --makeflags -j20;

• It downloaded cmake 3.24.3

• Uintah did not compile

• I will also try re-running without the --cmake flag

[hedgehog-fog]

• Using this command didn't work either (no --cmake flag):
  $ ./build_visit3_4_1 --parallel --uintah --no-icet --mesagl --llvm --no-sphinx --skip-opengl-context-check --qt6 --vtk9 --visit --makeflags -j20;

[tharman-git]

hedgehog-fog: I suspect there's an issue with the modifications you made to lines 21388 and 21409 of build_visit script. The quotations appear to be incorrect. I compared line 124629 of your log file to a log file from a version that compiled. Notice the quotations are not in the same place.

Your configure command:
'../src/configure <snip>         CFLAGS=-std=c++11' -fPIC '-O2             CXXFLAGS=-std=c++11' -fPIC '-O2  
                                        ^^^^^^^^^^^^^^^^^^                            ^^^^^^^^^^^^^^^^^^ 

Working configure command    
'../src/configure <snip          CFLAGS="-std=c++11  -m64 -fPIC  -O2" CXXFLAGS="-std=c++11  -m64 -fPIC  -O2" 

[hedgehog-fog]

@tharman-git Thanks for the heads up! Looks like Visit 3.4.1 is running successfully now. I checked a previous version of build_visit3_4_1 that compiled Uintah successfully, and noticed that some characters (escape chars?) were different on lines 21388 and 21409 (see below). After running the installation script, I could launch and use visit normally as any user on the system. Really appreciate the help, guys!

Working build/install steps for Visit 3.4.1 on ARM64:

1. This was completed on an ARM64 machine (Ampere Altra) running Ubuntu 22.04.4 Server
2. I used apt to install the following packages (see thread Compilation error 3.4.1:'QX11Application' is not a member of 'QNativeInterface' #19607), as well as common packages like python3 and cmake (I will try building on a fresh install system later to confirm what's needed):

libxkbcommon-x11-devel
xcb-util-devel
xcb-util-image-devel
xcb-util-keysyms-devel
xcb-util-renderutil-devel
xcb-util-wm-devel

3. I also changed my environment by adding the following lines to my ~/.bashrc:

export PAR_COMPILER=/usr/bin/mpic++
export PAR_COMPILER_CXX=/usr/bin/mpicxx
export PAR_INCLUDE="-I$OPENMPI_ROOT"/include

4. I dowloaded the install script to an empty local folder and added execution permissions:

$ wget https://github.com/visit-dav/visit/releases/download/v3.4.1/build_visit3_4_1
$ chmod +x build_visit3_4_1

5. I then edited build_visit3_4_1 to change the following lines as suggested by @biagas:

10808: llvm_opts="${llvm_opts} -DLLVM_TARGETS_TO_BUILD:STRING=host"
10810: llvm_opts="${llvm_opts} -DLLVM_TARGETS_TO_BUILD:STRING=host"

6. ...and changed the following lines for Uintah as suggested by @tharman-git (noting that future releases of Visit with Uintah 2.6.3 should not require this):

21388: CFLAGS=\"-std=c++11 $CFLAGS $C_OPT_FLAGS -headerpad_max_install_names\" CXXFLAGS=\"-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS\" \
21409: CFLAGS=\"-std=c++11 $CFLAGS $C_OPT_FLAGS\" CXXFLAGS=\"-std=c++11 $CXXFLAGS $CXX_OPT_FLAGS\" \

7. Then I ran the install script, which completed successfully.

$ ./build_visit3_4_1 --parallel  --uintah --no-icet  --mesagl --llvm --no-sphinx --skip-opengl-context-check --cmake --qt6 --vtk9  --visit --makeflags -j20;

9. My complete build_visit3_4_1 file and log file are available here: build_visit-20240821-03.tar.gz. Note that the following lines appear at the end of the build log file, not sure if it matters:

Symlinking current to 3.4.1
CMake Error: failed to create symbolic link '/usr/local/current': Permission denied

10. This generated the files visit3_4_1.linux-intel.tar.gz (250 MB) and visit-install. I then deleted my existing visit install and ran the install script:

$ sudo rm -rf /usr/local/visit
$ sudo ./visit-install 3.4.1 linux-intel /usr/local/visit

11. I then tested that visit to confirm that it could run successfully!

$ which visit
/usr/local/visit/bin/visit
$ visit 

[tharman-git]

@biagas : In a different thread I uploaded a version of Uintah, 2.6.3, which fixed the underlying compile problem, removing the need to modify build_visit script. Is it being distributed?

[biagas]

@tharman-git, are you saying that build Uintah 2.6.3 succeeds, but version 2.6.2 (the default for build_visit3_4_1) doesn't?
We could possibly update to using the newer version for our next release.

[tharman-git]

Yes, please use Uintah 2.6.3 for VisIt 3.4.1 and beyond.

[biagas]

@tharman-git I am having trouble finding a download for Uintah 2.6.3. Could you point me in the right direction?

[tharman-git]

Attached is Uintah 2.6.3.tar.gz
Uintah-2.6.3.tar.gz