{"id":4469,"date":"2018-08-27T20:59:58","date_gmt":"2018-08-28T01:59:58","guid":{"rendered":"http:\/\/neosmart.net\/blog\/?p=4469"},"modified":"2024-07-02T11:07:26","modified_gmt":"2024-07-02T16:07:26","slug":"could-not-find-avx-in-x86","status":"publish","type":"post","link":"https:\/\/neosmart.net\/blog\/could-not-find-avx-in-x86\/","title":{"rendered":"Rust Error: Could not find `avx` in `x86`"},"content":{"rendered":"

Let’s start this article with an error message right off the bat:1<\/a><\/sup><\/p>\n

~> cargo install ripgrep --features 'avx-accel simd-accel'\n    Updating<\/span> registry `https:\/\/github.com\/rust-lang\/crates.io-index`\n  Installing<\/span> ripgrep v0.9.0\n\u2026\nerror[E0432]<\/span>: unresolved import `simd::x86::avx`\n  --> \/home\/mqudsi\/.cargo\/registry\/src\/github.com-1ecc6299db9ec823\/bytecount-0.3.2\/src\/lib.rs:49:16\n   |\n49 | use simd::x86::avx::{LowHigh128, u8x32};\n   |                ^^^ Could not find `avx` in `x86`<\/span>\nerror<\/span>: aborting due to previous error\nFor more information about this error, try `rustc --explain E0432`.\nerror<\/span>: Could not compile `bytecount`.\n<\/pre>\n
<\/p>\n
Does the error look familiar? It’s a common one. The rust compiler does not avail itself of processor-specific features and capabilities needed to perform advanced optimizations or to use vectorized instructions like the SSE{,2,3,4{,.1,.2}}2<\/a><\/sup> or AVX intrinsics. But some cargo crates have features that take advantage of these features — and depending on your platform and architecture, compilation will fail with an error like the one above.<\/p>\n
While bytecount<\/code>\u00a0is a common culprit, it’s by no means the only one, and you can encounter this error (or one like it) with pretty much any crate trying to use lower-level CPU instructions. Fortunately in this case if we were to try compiling\/installing ripgrep<\/code>\u00a0normally without the --features ...<\/code>\u00a0bit we would not encounter this error at all, but what’s the use of using the fastest code search utility on the planet on an advanced CPU you paid good money for if you’re not planning on milking every last drop of performance you can get out of it?<\/p>\n
The solution is to explicitly instruct the rustc<\/code>\u00a0compiler to use all the capabilities of your CPU, including those not necessarily found on other machines in your platform (which will cause the binaries you build to no longer be guaranteed to run on another ABI-compatible machine).3<\/a><\/sup> If you set the RUSTC_FLAGS<\/code>\u00a0environment variable prior to invoking cargo install ...<\/code>\u00a0to instruct the compiler to use the native capabilities of the CPU, that’s exactly what we get:<\/p>\n
~> env RUSTFLAGS=\"-C target-cpu=native\"<\/strong> \\\n       cargo install ripgrep --features 'avx-accel simd-accel'\n    Updating<\/span> registry `https:\/\/github.com\/rust-lang\/crates.io-index`\n  Installing<\/span> ripgrep v0.9.0\n    Finished<\/span> release [optimized + debuginfo] target(s) in 58.88s\n   Replacing<\/span> \/home\/mqudsi\/.cargo\/bin\/rg\n<\/pre>\n
Note that you may see a message like the following:<\/p>\n
‘native’ is not a recognized processor for this target (ignoring processor)<\/p><\/blockquote>\n
This is perfectly normal — some crates try to introspect the current value of target-cpu<\/code>\u00a0to take differing build actions, and are unable to identify native<\/code>\u00a0as a valid CPU target (which makes sense, since it’s really a\u00a0meta<\/em> target and not a real one).<\/p>\n
  1. I’m primarily blogging this as I’ve run into \u2013 and worked around \u2013 this error several times before running into it again and not being able to remember how I resolved this problem the last time around. ↩<\/a><\/p><\/li>
  2. fish’s nested parameter expansion ftw! ↩<\/a><\/p><\/li>
  3. There is a proposal to add a crate-level profiling option to enable this automatically over at rust-lang\/cargo#2535<\/a>. ↩<\/a><\/p><\/li><\/ol>","protected":false},"excerpt":{"rendered":"
    Let’s start this article with an error message right off the bat:1 ~> cargo install ripgrep –features ‘avx-accel simd-accel’ Updating registry `https:\/\/github.com\/rust-lang\/crates.io-index` Installing ripgrep v0.9.0 \u2026 error[E0432]: unresolved import `simd::x86::avx` –> \/home\/mqudsi\/.cargo\/registry\/src\/github.com-1ecc6299db9ec823\/bytecount-0.3.2\/src\/lib.rs:49:16 | 49 | use simd::x86::avx::{LowHigh128, u8x32}; | ^^^ … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":505,"featured_media":4454,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[1],"tags":[986,988,987,936],"class_list":["post-4469","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-software","tag-avx","tag-cargo","tag-ripgrep","tag-rust"],"aioseo_notices":[],"jetpack_featured_media_url":"https:\/\/neosmart.net\/blog\/wp-content\/uploads\/rust-logo.png","jetpack_shortlink":"https:\/\/wp.me\/p4xDa-1a5","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/posts\/4469","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/users\/505"}],"replies":[{"embeddable":true,"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/comments?post=4469"}],"version-history":[{"count":7,"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/posts\/4469\/revisions"}],"predecessor-version":[{"id":5193,"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/posts\/4469\/revisions\/5193"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/media\/4454"}],"wp:attachment":[{"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/media?parent=4469"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/categories?post=4469"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/neosmart.net\/blog\/wp-json\/wp\/v2\/tags?post=4469"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}