Out-of-bounds memory access runtime error found in std::array<float, 4> getOriginBox(const std::array<float, 4> &box, ...)

Hi, I have found an out-of-bounds access error in the function linked below. The error occurs at line 28 when trying to access box[4] (fifth element) because box can only contain four elements at max.
https://github.com/nndeploy/nndeploy/blob/5f57d2d19000fcdf62569d62739c49906863146f/plugin/source/nndeploy/detect/util.cc#L20-L31
Example (to reproduce error)
extern "C" int LLVMFuzzerTestOneInput(uint8_t *Data, size_t Size)
{
    if (Size < 20) {return 0;}
    float *fuzzedInp = reinterpret_cast<float*>(Data);
    std::array<float, 4> mBox = {fuzzedInp[0], fuzzedInp[1], fuzzedInp[2], fuzzedInp[3]};
    float mXOffset = fuzzedInp[4];
    float mYOffset = fuzzedInp[4] * 0.4;
    int mHeight = Size * 0.5;
    int mWidth = Size * 0.8;
    getOriginBox(mBox,fuzzedInp,mXOffset,mYOffset,mWidth,mHeight);
    return 0;
}

Crash report
INFO: Running with entropic power schedule (0xFF, 100).
INFO: Seed:<PHONE_NUMBER>
INFO: Loaded 1 modules   (57 inline 8-bit counters): 57 [0x555fe3b400a0, 0x555fe3b400d9),
INFO: Loaded 1 PC tables (57 PCs): 57 [0x555fe3b400e0,0x555fe3b40470),
INFO: -max_len is not provided; libFuzzer will not generate inputs larger than 4096 bytes
INFO: A corpus is not provided, starting from an empty corpus
#2      INITED cov: 2 ft: 2 corp: 1/1b exec/s: 0 rss: 33Mb
=================================================================
==43861==ERROR: AddressSanitizer: stack-buffer-overflow on address 0x7f2a3c11c3b0 at pc 0x555fe3af8ab8 bp 0x7ffc2070b180 sp 0x7ffc2070b178
READ of size 4 at 0x7f2a3c11c3b0 thread T0
    #0 0x555fe3af8ab7 in getOriginBox(std::array<float, 4ul> const&, float const*, float, float, int, int) fuzzer.cpp:16:25
    #1 0x555fe3af8f6a in LLVMFuzzerTestOneInput fuzzer.cpp:30:5
    #2 0x555fe3a03c54 in fuzzer::Fuzzer::ExecuteCallback(unsigned char const*, unsigned long) (utilFuzzer_getOriginBox+0x4dc54) (BuildId: d41ba62ddaf45703cff6299eb93f316ba272a94a)
    #3 0x555fe3a03349 in fuzzer::Fuzzer::RunOne(unsigned char const*, unsigned long, bool, fuzzer::InputInfo*, bool, bool*) (utilFuzzer_getOriginBox+0x4d349) (BuildId: d41ba62ddaf45703cff6299eb93f316ba272a94a)
    #4 0x555fe3a04b35 in fuzzer::Fuzzer::MutateAndTestOne() (utilFuzzer_getOriginBox+0x4eb35) (BuildId: d41ba62ddaf45703cff6299eb93f316ba272a94a)
    #5 0x555fe3a05695 in fuzzer::Fuzzer::Loop(std::vector<fuzzer::SizedFile, std::allocator<fuzzer::SizedFile>>&) (utilFuzzer_getOriginBox+0x4f695) (BuildId: d41ba62ddaf45703cff6299eb93f316ba272a94a)
    #6 0x555fe39f296f in fuzzer::FuzzerDriver(int*, char***, int (*)(unsigned char const*, unsigned long)) (utilFuzzer_getOriginBox+0x3c96f) (BuildId: d41ba62ddaf45703cff6299eb93f316ba272a94a)
    #7 0x555fe3a1cff6 in main (utilFuzzer_getOriginBox+0x66ff6) (BuildId: d41ba62ddaf45703cff6299eb93f316ba272a94a)
    #8 0x7f2a3df651c9  (/lib/x86_64-linux-gnu/libc.so.6+0x2a1c9) (BuildId: 6d64b17fbac799e68da7ebd9985ddf9b5cb375e6)
    #9 0x7f2a3df6528a in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x2a28a) (BuildId: 6d64b17fbac799e68da7ebd9985ddf9b5cb375e6)
    #10 0x555fe39e7954 in _start (utilFuzzer_getOriginBox+0x31954) (BuildId: d41ba62ddaf45703cff6299eb93f316ba272a94a)

Address 0x7f2a3c11c3b0 is located in stack of thread T0 at offset 48 in frame
    #0 0x555fe3af8c07 in LLVMFuzzerTestOneInput fuzzer.cpp:22

  This frame has 1 object(s):
    [32, 48) 'mBox' (line 25) <== Memory access at offset 48 overflows this variable
HINT: this may be a false positive if your program uses some custom stack unwind mechanism, swapcontext or vfork
      (longjmp and C++ exceptions *are* supported)
SUMMARY: AddressSanitizer: stack-buffer-overflow fuzzer.cpp:16:25 in getOriginBox(std::array<float, 4ul> const&, float const*, float, float, int, int)
Shadow bytes around the buggy address:
  0x7f2a3c11c100: f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5
  0x7f2a3c11c180: f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5
  0x7f2a3c11c200: f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5
  0x7f2a3c11c280: f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5
  0x7f2a3c11c300: f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5 f5
=>0x7f2a3c11c380: f1 f1 f1 f1 00 00[f3]f3 00 00 00 00 00 00 00 00
  0x7f2a3c11c400: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x7f2a3c11c480: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x7f2a3c11c500: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x7f2a3c11c580: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
  0x7f2a3c11c600: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
Shadow byte legend (one shadow byte represents 8 application bytes):
  Addressable:           00
  Partially addressable: 01 02 03 04 05 06 07
  Heap left redzone:       fa
  Freed heap region:       fd
  Stack left redzone:      f1
  Stack mid redzone:       f2
  Stack right redzone:     f3
  Stack after return:      f5
  Stack use after scope:   f8
  Global redzone:          f9
  Global init order:       f6
  Poisoned by user:        f7
  Container overflow:      fc
  Array cookie:            ac
  Intra object redzone:    bb
  ASan internal:           fe
  Left alloca redzone:     ca
  Right alloca redzone:    cb
==43861==ABORTING

Potential fix
My hunch is that this is how float xmax and float ymax should be computed:
std::array<float, 4> getOriginBox(const std::array<float, 4> &box,
                                  const float *scale_factor, float x_offset,
                                  float y_offset, int ori_width,
                                  int ori_height) {
  float xmin = std::max(box[0] / scale_factor[0] + x_offset, 0.f);
  float ymin = std::max(box[1] / scale_factor[1] + y_offset, 0.f);
  //use box[2] instead of box[3]
  float xmax = std::min(box[2] / scale_factor[2] + x_offset,
                        static_cast<float>(ori_width) - 1.f);
  //use box[3] instead of box[4]
  float ymax = std::min(box[3] / scale_factor[3] + y_offset,
                        static_cast<float>(ori_height) - 1.f);
  return {xmin, ymin, xmax, ymax};
}

But I could be wrong since I am only guessing what the correct computation should be.
Please let me know if you have any questions :)
Sincerely,
Arpan Srivastava

Thank you for pointing out the mistake. Your understanding is correct: the implementation of the getOriginBox function was incorrect, and your subsequent implementation is correct. Could you please submit a pull request (PR) to fix this bug?

Done. Please feel free to make suggestions if you have any.

Thank you very much for your contributions to our project, especially for the issues and pull requests (PRs) you've raised. Your issues are well-organized and well-substantiated. We are eagerly looking forward to your continued active participation in our project to jointly advance its development.


Hi Pri: Update Participedia School Page Text (all languages)

@paninee please implement the edits noted in this document asap: https://docs.google.com/document/d/1ullqQ1mdI8ZSLoYoJ0FzMwER-qKYUEhmoApFuyz3CZo/edit

done


cannot create SSL/TLS secure channel

🐛 Bug Report
Upon running the command to create a new database, the following error is returned:

Unhandled Exception: System.AggregateException: One or more errors occurred. ---> System.AggregateException: One or more errors occurred. ---> System.Net.WebException: The request was aborted: Could not create SSL/TLS secure channel.
See attached for full output.  Might an update be needed for newer TSL version?
To Reproduce
Steps to reproduce the behavior:

issue the command to create a new database
zd-exporter-error-output.txt

Updating the projects to .net 4.6.1 will fix the TLS 1.2 issue as the current .net version doesn't support it.

Project no longer maintained. Closing issue in preparation for archiving.


link css don't applied in ready hook.

If I don't use Single File Components and webpack, and my html template looks like:

  <link href="/app/component/tootip/tooltip.css"/>

    some tooltip template

and the tooltip.js looks like:
Vue.component('tooltip', {
    template: require('./tooltip.html', 'html'),
    data: function() {
      return {
        data: {}
      };
    },
    ready: function() {
      // do some position calculation like offsetLeft, offsetWidth
    });
  });

I debugged the code and found when ready hook is called, the tootip.css is still pending, so the position attribute like offsetLeft,offsetWidth is not the actural value that I wanted.

Then, how to fix this problem?

This is because <link> triggers an HTTP request to fetch the CSS after it is inserted (which is asynchronous). Ready is called synchronously after insertion. It's just the way it works.
Short answer is you should just use Vueify.


Replace mutexes around primitive types with atomics

Simplifies some code (e.g. using atomic fetch-add) and also reduces the number of points of failure, as atomic reads never fail.

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 84cc329d062b29b24330192df9b3e13d7a03fb3b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 805fc9164a488403088754fee803b184148e3130
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: c788c27df70690ac7cf2bf7186ee0d872c44f97f
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 53ac2a3ae0dd3c3c584276403c6bcd2c52a3fdfc
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 03f0fd5c1082e4cb9f8eb7ab9bc157a7b9b41730
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 6c8bd92e3237a1e03aa215a97f4f0cb1e230b733
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 25da96947e4280c09908a667c5eae7a490c832c3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 8a5e9eae6d87493e4257b599fb690098b3c6915a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 3467cfe192629a0e1109579aac7d23c3f8029139
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 832a5083c4af6e8e5d7e7cce817f24880e357c48
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Seems like a spurious error, failing to fetch optee_utee from its Git repository.  I will restart the CI.

AWS CodeBuild CI Report

CodeBuild project: Veracruz
Commit ID: 832a5083c4af6e8e5d7e7cce817f24880e357c48
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

+1 reached, merging


Handle all primitive types in internal layouts in the generated C#

We have the following piece in the C# generator:
// we do not support the primitives below yet because their representation in C# is problematic
if (coreType.IsPrimitiveType(PrimitiveType.LongDouble) ||
    coreType.IsPrimitiveType(PrimitiveType.Int128) ||
    coreType.IsPrimitiveType(PrimitiveType.UInt128) ||
    coreType.IsPrimitiveType(PrimitiveType.Half))
    return;

This is troublesome now that we have an option for generating sequential layouts. We need to find a way to represent such fields and include them in our internal layouts.

We can use fixed-size buffers.
https://msdn.microsoft.com/en-us/library/zycewsya.aspx


Not Found react-native-fbsdk-next in the Maven Repository

Hello, I am facing a problem when using your library in developing my application using react-native with expo version 50.0, this week I build a new apk for Android preview and I receive a 502 error that it did not find the lib repository in the Maven, what can I do to make it work?

https://oss.sonatype.org/content/repositories/snapshots/com/facebook/android/facebook-android-sdk/maven-metadata.xml

same issue any one resolve this?

@dohainamhn you have a network issue, nothing to do with this project

I resolve this problem, with compile my project in another day


Automockable name improvement

This resolves the discussion around #407
For
protocol CurrencyPresenter: AutoMockable {
    func showSourceCurrency(_ currency: String)
}

The generated code now:
class CurrencyPresenterMock: CurrencyPresenter {

    //MARK: - showSourceCurrency

    var showSourceCurrencyCalled = false
    var showSourceCurrencyReceivedCurrency: String?

    func showSourceCurrency(_ currency: String) {
        showSourceCurrencyCalled = true
        showSourceCurrencyReceivedCurrency = currency
    }

}

Thanks @Liquidsoul for pointing proper macro usage to me 👍

          1 Error

:no_entry_sign:
fit left in tests

  Generated by :no_entry_sign: Danger

@Antondomashnev maybe will make sense to merge this pr with #397?

@ilyapuchka it does make sense 😄 Will close #397 and update that one.


500 error on status page

Cachet installed ok and working properly from the admin console but the status page is showing a 500 error....
This error can be identified by d55bb28a-6f65-4e2f-a5ad-e86447f09016. You might want to take a note of this code.
Any ideas on this one?

I have also just noticed that if I try to open Settings > Stylesheet then my Apache HTTP Server crashes.
[Fri Aug 14 11:57:15.896712 2015] [mpm_winnt:notice] [pid 3564:tid 408] AH00428: Parent: child     process 300 exited with status<PHONE_NUMBER> -- Restarting. httpd.exe: Syntax error on line 72 of C:/xampp/apache/conf/httpd.conf: Cannot load modules/mod_access_compat.so into server: Invalid access to memory location.
Apache auto-restarts ok it only crashes when trying to access the Stylesheet option in the Dashboard.
Could this be related to the same issue I am having with the status page not loading (error 500)?
Other web apps on the same server are running fine and I have all the requirements for Cachet installed. The only thing I had to do was run the command
composer install --no-dev -o --no-scripts

as I am on a Windows server.

This error can be identified by d55bb28a-6f65-4e2f-a5ad-e86447f09016. You might want to take a note of this code.

That error code isn't unique to the type of error. That code is unique to the particular error occurrence, that's all. :)

Please could you show us your logs.

What version of Cachet, and what version of php too.

--no-scripts

You still need to run the scripts manually though.

That's probably what's causing you issues.

We should better document Windows installations...

How and what scripts would I run manually on Windows?

On 14 Aug 2015, at 23:42, Graham Campbell<EMAIL_ADDRESS>wrote:
That's probably what's causing you issues.
—
Reply to this email directly or view it on GitHub.

That would be helpful :)
I would have used Linux but that's only for Dev not production.

On 14 Aug 2015, at 23:42, James Brooks<EMAIL_ADDRESS>wrote:
We should better document Windows installations...
—
Reply to this email directly or view it on GitHub.

The ones in the composer file.

Basically Windows doesn't have an rm command, so you'll need to manually delete the files.

Though windows does in some environments. :)

Cygwin, or some fancy git thing.

@thedaftbadger I'm closing this issue as it's not Cachet directly, but feel free to continue updating the thread. We'll help you.

Ok so I am still struggling :(
I am running Cachet on Windows Server 2012 R2 using XAMPP. Several other web applications are also running on this server but I have checked that all the prerequisites for Cachet are installed correctly.
The install directory for the files are.... C:\xampp\htdocs\cachet
Composer is installed and working properly as it was used for some of the the other web apps hosted on this server.

I have downloaded the master release from GitHub and places the files here C:\xampp\htdocs\cachet

Configured the .env.example file for the MySQL database I wish to use (hosted on same server).

Ran the following windows command to rename .env.example to .env
 rename C:\xampp\htdocs\cachet\.env.example .env

Ran composer in C:\xampp\htdocs\cachet with this command composer install --no-dev -o --no-scripts

Composer installed correctly. Then ran this to add database tables php artisan migrate which completes ok.

Generated security key using php artisan key:generate

Configured my httpd-vhosts.conf file

<VirtualHost *:80>
ServerName ukstatus.example.local
DocumentRoot "C:\xampp\htdocs\cachet\public"
<Directory "C:\xampp\htdocs\cachet\public">
Options Indexes FollowSymLinks
AllowOverride All
Order allow,deny
Allow from all
</Directory>
</VirtualHost>

Configured windows host file under C:\Windows\System32\drivers\etc\hosts with <IP_ADDRESS> ukstatus.example.local

Restarted windows and checked that Apache and MySQL are running correctly.

Navigated to http://ukstatus.example.local and ran the Cachet setup utility. Dashboard runs correctly but unable to access the status page as I get a 500 error.

I am guessing this is because some of the scripts required in the installation have not ran properly. What scripts need running and how do I run them, through composer I guess?
I have noticed that if I try and access the Theme settings page then my Apache HTTP Server stops working.
[Mon Aug 17 08:16:16.824059 2015] [mpm_winnt:notice] [pid 3888:tid 404] AH00428: Parent: child process 3324 exited with status<PHONE_NUMBER> -- Restarting.
[Mon Aug 17 08:16:16.995922 2015] [ssl:warn] [pid 3888:tid 404] AH01909: server.example.com:443:0 server certificate does NOT include an ID which matches the server name
[Mon Aug 17 08:16:17.042795 2015] [mpm_winnt:notice] [pid 3888:tid 404] AH00455: Apache/2.4.12 (Win32) OpenSSL/1.0.1m PHP/5.6.11 configured -- resuming normal operations
[Mon Aug 17 08:16:17.042795 2015] [mpm_winnt:notice] [pid 3888:tid 404] AH00456: Apache Lounge VC11 Server built: Mar 20 2015 12:12:41
[Mon Aug 17 08:16:17.042795 2015] [core:notice] [pid 3888:tid 404] AH00094: Command line: 'c:\\xampp\\apache\\bin\\httpd.exe -d C:/xampp/apache'
[Mon Aug 17 08:16:17.042795 2015] [mpm_winnt:notice] [pid 3888:tid 404] AH00418: Parent: Created child process 2588
AH00548: NameVirtualHost has no effect and will be removed in the next release C:/xampp/apache/conf/extra/httpd-vhosts.conf:20

Don't use master, use a tagged release. See the installation instructions on our docs: https://docs.cachethq.io/docs/installing-cachet

Sorry I worded it wrongly :)
I am using tagged release version 1.1.1
On Aug 17, 2015, at 10:58 AM, James Brooks<EMAIL_ADDRESS>wrote:
Don't use master, use a tagged release. See the installation instructions on our docs: https://docs.cachethq.io/docs/installing-cachet
—
Reply to this email directly or view it on GitHub.

What scripts do I need to run manually?

So I have ran the following commands manually....
php artisan optimize --force
php artisan config:cache
php artisan route:cache

And now I guess I need to delete these files but I am not sure on their location...
compiled.php config.php routes.php services.json
I have noticed that even though these files have been deleted and I have ran the above scripts manually I cant get the status page to not 500 error. The dashboard still works fine.

You need to delete from ./bootstrap/cache/

Ok thanks @jbrooksuk Would the files in ./bootstrap/cache/ cause my status page not to work?


Linked website points to expired domain

As of 2019-04-17 the linked website points to an expired domain:

Closing it as it is not being attended to and I don't want it on my GitHub dashboards


gitops run doesn't accept failure to reconcile

When I

Write a bad error in my kustomization - in my case, one of the yaml documents my kustomization included started with -- instead of --- 🙈
See that my pod isn't starting
Use kubectl to figure out that my kustomization is incorrect
Fix it
Hit save

Then I expect gitops run to pick it up and reconcile the fix.
What instead happens is that I have to wait 5 minutes for a timeout to occur.
While on some level it's working as intended (5 minute timeout innit), as a user I am happy to wait 5 minutes for a process to complete, but I get unhappy when the process has already completed and we're just waiting 5 minutes to accept the result.
Could we make the watch process have a shorter timeout, even if the flux resource timeouts are still longer?

Client-side YAML validation would be useful in this and similar scenarios.

Another example than a pure syntax error seems to be if I reference a chart that doesn't exist.
So yaml validation would be awesome, but I don't think that fully solves this problem.


Can't install via CocoaPods on iOS 9.3

CocoaPods won't install with error message "Specs satisfying the WebViewWarmUper dependency were found, but they required a higher minimum deployment target." However manually adding the file works with no alterations.

@sarahjstacey15 I‘ll try to reduce minimum requirement version to iOS 9.

Thank you 😊


setup fails to create virtualenv when multiple python2.7 are installed

setup.sh script creates virtualenv. If multiple python interpreters are present on the system this fails.  I will work on getting this committed.

Fixed using #75


Update s3 to 2.15.50

Updates software.amazon.awssdk:s3 from 2.15.45 to 2.15.50.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "software.amazon.awssdk", artifactId = "s3" } ]

labels: library-update, semver-patch

Superseded by #286.


Crash and excessive messages written to kern.log file with 1.7.60

Hi,
After I installed ROCm there seems to be an error that generates too many messages in kern.log.
The current kern.log file is 3.4 GiB from just 53 hours of logs. And every log file after the install is large.
I get up to 285 KiB/s of this text in my kern.log file:
Mar 20 14:11:33 name kernel: [528534.415895] [drm:handle_cursor_update.isra.30 [amdgpu]] handle_cursor_update: crtc_id=0 with size 128 to 128
Mar 20 14:11:33 name kernel: [528534.416603] [drm:amdgpu_dm_atomic_check [amdgpu]] amdgpu_crtc id:0 crtc_state_flags: enable:1, active:1, planes_changed:0, mode_changed:0,active_changed:0,connectors_changed:0
Mar 20 14:11:33 name kernel: [528534.416682] [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] amdgpu_crtc id:0 crtc_state_flags: enable:1, active:1, planes_changed:1, mode_changed:0,active_changed:0,connectors_changed:0
Mar 20 14:11:33 name kernel: [528534.416748] [drm:modeset_required [amdgpu]] Mode change not required, setting mode_changed to 0
...
The same 4 lines just repeats unmodified as far as I can tell, except for the time-stamp. It also seems to be generated when I move my mouse.
In addition these lines are added ~every second:
Mar 20 14:11:33 name kernel: [528534.458385] [drm:prepare_flip_isr [amdgpu]] crtc:0, pflip_stat:AMDGPU_FLIP_SUBMITTED
Mar 20 14:11:33 name kernel: [528534.458452] [drm:amdgpu_dm_do_flip [amdgpu]] amdgpu_dm_do_flip Flipping to hi: 0xf4, low: 0xf9140000
Mar 20 14:11:33 name kernel: [528534.461795] [drm:dm_pflip_high_irq [amdgpu]] dm_pflip_high_irq - crtc :0[ffff9ad48ec4a000], pflip_stat:AMDGPU_FLIP_NONE
Mar 20 14:11:33 name kernel: [528534.474072] [drm:prepare_flip_isr [amdgpu]] crtc:0, pflip_stat:AMDGPU_FLIP_SUBMITTED
Mar 20 14:11:33 name kernel: [528534.474141] [drm:amdgpu_dm_do_flip [amdgpu]] amdgpu_dm_do_flip Flipping to hi: 0xf4, low: 0xd2d80000
Mar 20 14:11:33 name kernel: [528534.478487] [drm:dm_pflip_high_irq [amdgpu]] dm_pflip_high_irq - crtc :0[ffff9ad48ec4a000], pflip_stat:AMDGPU_FLIP_NONE
...
Then, every few seconds this is added:
Mar 20 14:11:56 name kernel: [528557.291929] [drm:dm_plane_helper_prepare_fb [amdgpu]] No FB bound
Mar 20 14:11:56 name kernel: [528557.292180] [drm:handle_cursor_update.isra.30 [amdgpu]] handle_cursor_update: crtc_id=0 with size 0 to 0
...
Finally, the first crash seems to come from dc_plane_state_retain:
Mar 20 14:33:19 name kernel: [529839.855466] ------------[ cut here ]------------
Mar 20 14:33:19 name kernel: [529839.855560] WARNING: CPU: 5 PID: 1398 at /var/lib/dkms/rock/1.7.60-ubuntu/build/amd/amdgpu/../display/dc/core/dc_surface.c:125 dc_plane_state_retain+0x1e/0x30 [amdgpu]
Mar 20 14:33:19 name kernel: [529839.855561] Modules linked in: binfmt_misc snd_hda_codec_realtek snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm intel_rapl snd_seq_midi snd_seq_midi_event x86_pkg_temp_thermal intel_powerclamp snd_rawmidi coretemp crct10dif_pclmul input_leds crc32_pclmul ghash_clmulni_intel pcbc snd_seq snd_seq_device aesni_intel snd_timer aes_x86_64 crypto_simd glue_helper cryptd intel_cstate snd intel_rapl_perf mei_me lpc_ich mei soundcore shpchp mac_hid kvm_intel kvm irqbypass nfsd auth_rpcgss nfs_acl lockd grace sunrpc parport_pc ppdev lp parport autofs4 btrfs xor raid6_pq hid_generic usbhid hid amdkfd(OE) amd_iommu_v2 amdgpu(OE) amdttm(OE) mxm_wmi amdkcl(OE) i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops e1000e drm alx ptp ahci mdio
Mar 20 14:33:19 name kernel: [529839.855630]  nvme pps_core libahci nvme_core wmi
Mar 20 14:33:19 name kernel: [529839.855640] CPU: 5 PID: 1398 Comm: Xorg Tainted: G        W  OE   4.13.0-36-generic #40~16.04.1-Ubuntu
Mar 20 14:33:19 name kernel: [529839.855641] Hardware name: To Be Filled By O.E.M.
I have not yet updated to version 1.7.137.
GPU:
03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Baffin [Radeon RX 550 640SP / RX 560] (rev cf)
uname -a:
Linux name 4.13.0-36-generic #40~16.04.1-Ubuntu SMP Fri Feb 16 23:25:58 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
gcc --version:
gcc (Ubuntu 5.4.1-2ubuntu1~16.04) 5.4.1 2016090
In addition the system have been unstable, even with light usage. When the system dies only the mouse pointer works, even Ctrl+Alt+F1 do not work.

I'm seeing the same. Almost exactly the same installation, but I AM updated to 1.7.137. System was stable on AMDGPU pro - experienced crash after switching to open source drivers.

This is a unrelated driver issue, I have seen it and fixed it on the dev build system I made. In my case it will and can be duplicated by the r8168 stock nic driver.  kvm_intel kvm irqbypass nfsd auth_rpcgss nfs_acl lockd grace sunrpc parport_pc ppdev lp parport autofs4 btrfs xor raid6_pq hid_generic
Looking at your drivers I can see that you still have your parallel port tieing up irqs and kvm and nfs?
 Here is the script I use to first black list a module in /etc/modprobe.d/blacklist.conf
paraport ppdev for example
blacklist paraport
blacklist ppdev
blacklist r8169
Then try
cat /etc/modprobe.d/blacklist.conf | grep blacklist | sed s/blacklist//g  | xargs rmmod
to remove all the blacklisted modules.

Mar 20 14:33:19 name kernel: [529839.952797] Modules linked in: binfmt_misc snd_hda_codec_realtek snd_hda_codec_generic snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core snd_hwdep snd_pcm intel_rapl snd_seq_midi snd_seq_midi_event x86_pkg_temp_thermal intel_powerclamp snd_rawmidi coretemp crct10dif_pclmul input_leds crc32_pclmul ghash_clmulni_intel pcbc snd_seq snd_seq_device aesni_intel snd_timer aes_x86_64 crypto_simd glue_helper cryptd intel_cstate snd intel_rapl_perf mei_me lpc_ich mei soundcore shpchp mac_hid kvm_intel kvm irqbypass nfsd auth_rpcgss nfs_acl lockd grace sunrpc parport_pc ppdev lp parport autofs4 btrfs xor raid6_pq hid_generic usbhid hid amdkfd(OE) amd_iommu_v2 amdgpu(OE) amdttm(OE) mxm_wmi amdkcl(OE) i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops e1000e drm alx ptp ahci mdio
Mar 20 14:33:19 name kernel: [529839.952861]  nvme pps_core libahci nvme_core wmi
Mar 20 14:33:19 name kernel: [529839.952869] CPU: 5 PID: 1398 Comm: Xorg Tainted: G        W  OE   4.13.0-36-generic #40~16.04.1-Ubuntu
Please try the follow to fix the problem
apt-get install linux-image-4.13.0-32-generic
apt-get --purge remove 4.13.0-36-generic
When you updated you updated from the 16.04.3 to the 16.04.4 kernel which has this issue :)
Thank you and have a nice day

You might want to try the following grub line
GRUB_CMDLINE_LINUX_DEFAULT="init=/lib/sysvinit/init apparmor=0 security="" selinux=0 amdgpu.vm_fragment_size=9 nmi_watchdog=0 pti=off 3 spectre_v2=off nospectre_v2 retp=0 ibrs=0 ibpb=0 amdgpu.hw_i2c=1 isolcpus=5,6,7 nohz_full=5,6,7 processor.max_cstate=1 radeon.clk_support=0 amdgpu.clk_support=1 intel_pstate=disable audit=0 thermal.off=1 clocksource=hpet intel_iommu=on iommu=pt"

I have blacklisted the r8169, ppdev and paraport driver, switched to 4.13.0-32-generic and updated to rocm 1.7.137. However there are still crashes.
It also seems the reason the log is so massive is a grub option 'drm.debug=0xe'.

GRUB_CMDLINE_LINUX_DEFAULT="init=/lib/sysvinit/init apparmor=0 security="" selinux=0 amdgpu.vm_fragment_size=9 nmi_watchdog=0 pti=off 3 spectre_v2=off nospectre_v2 retp=0 ibrs=0 ibpb=0 amdgpu.hw_i2c=1 isolcpus=5,6,7 nohz_full=5,6,7 processor.max_cstate=1 radeon.clk_support=0 amdgpu.clk_support=1 intel_pstate=disable audit=0 thermal.off=1 clocksource=hpet intel_iommu=on iommu=pt"

This seems to be tuned to a custom mining setup. I can not use the grub line unmodified however. This is my workstation at work, and disabling security is not a real option.
This set of options disable lots of security features:
apparmor=0 -- Disable normal security
selinux=0 -- Useless on Ubuntu (disable security)
pti=off 3  -- Spectre/Meltdown
spectre_v2=off -- Spectre/Meltdown
nospectre_v2 -- Spectre/Meltdown
retp=0 -- Spectre/Meltdown
ibrs=0 -- Spectre/Meltdown
ibpb=0 -- Spectre/Meltdown
Is it likely these security features impact the crash issue?
This will remove 3 of my 12 CPU threads:
isolcpus=5,6,7 -- Remove CPU 5,6 and 7 from the system :(
nohz_full=5,6,7 -- Set CPU  5,6 and 7 to be in adaptive-ticks mode "reduce the number of scheduling-clock interrupts" ?
The system is stable with 100% load on all cores for days, and all crash scenarios have been in ~1-5% load.
More interrupts disabled:
nmi_watchdog=0 -- CPU crash handling (interrupt)
Is the cause related to interrupts?
Disable all CPU energy optimizations:
processor.max_cstate=1 -- Disable all CPU sleep/low-power states.
intel_pstate=disable -- Disable the Intel CPU frequency/performance handler.
Is the crash related to CPUsleep states?
Enable features for VM's:
intel_iommu=on  -- Used to speed up a VM's access to hardware
iommu=pt" -- Used to speed up a VM's access to hardware
I do not run any VM's, but will this set of options impact the GPU driver anyway?
Other options:
audit=0   -- Disable various logging features. ?
thermal.off=1 -- Disable ACPI thermal support ?
clocksource=hpet -- Change timers from TSC to HPET (slower) ?
I don't see why any of those options can cause a crash, unless they generate interrupts somehow. Are they likely to be related to the crash issue?
GPU driver related options:
amdgpu.vm_fragment_size=9 -- Use 2 MiB page size.
amdgpu.hw_i2c=1 -- Enable temperature sensor?
radeon.clk_support=0 -- Useless?
amdgpu.clk_support=1 -- ?
Only the vm_fragment_size seems relevant, but it seems to be intended to improve crypto-mining.
So far every crash seems to have happened when I have tried to move the mouse after writing some text, and all the logs are also related to moving the mouse. So this is not likely to happen in a mining system at all.
Is the best way to get a stable system to switch to AMDGPU pro with my setup, or are there other things I can try?

Close it is most likely from, the virtualization in the bios. disable it
vxd..
On Mon, Apr 16, 2018 at 8:43 PM, Runeerle<EMAIL_ADDRESS>wrote:

I have blacklisted the r8169, ppdev and paraport driver, switched to
4.13.0-32-generic and updated to rocm 1.7.137. However there are still
crashes.
It also seems the reason the log is so massive is a grub option
'drm.debug=0xe'.
GRUB_CMDLINE_LINUX_DEFAULT="init=/lib/sysvinit/init apparmor=0
security="" selinux=0 amdgpu.vm_fragment_size=9 nmi_watchdog=0 pti=off 3
spectre_v2=off nospectre_v2 retp=0 ibrs=0 ibpb=0 amdgpu.hw_i2c=1
isolcpus=5,6,7 nohz_full=5,6,7 processor.max_cstate=1 radeon.clk_support=0
amdgpu.clk_support=1 intel_pstate=disable audit=0 thermal.off=1
clocksource=hpet intel_iommu=on iommu=pt"
This seems to be tuned to a custom mining setup. I can not use the grub
line unmodified however. This is my workstation at work, and disabling
security is not a real option.
This set of options disable lots of security features:
apparmor=0 -- Disable normal security
selinux=0 -- Useless on Ubuntu (disable security)
pti=off 3 -- Spectre/Meltdown
spectre_v2=off -- Spectre/Meltdown
nospectre_v2 -- Spectre/Meltdown
retp=0 -- Spectre/Meltdown
ibrs=0 -- Spectre/Meltdown
ibpb=0 -- Spectre/Meltdown
Is it likely these security features impact the crash issue?
This will remove 3 of my 12 CPU threads:
isolcpus=5,6,7 -- Remove CPU 5,6 and 7 from the system :(
nohz_full=5,6,7 -- Set CPU 5,6 and 7 to be in adaptive-ticks mode "reduce
the number of scheduling-clock interrupts" ?
The system is stable with 100% load on all cores for days, and all crash
scenarios have been in ~1-5% load.
More interrupts disabled:
nmi_watchdog=0 -- CPU crash handling (interrupt)
Is the cause related to interrupts?
Disable all CPU energy optimizations:
processor.max_cstate=1 -- Disable all CPU sleep/low-power states.
intel_pstate=disable -- Disable the Intel CPU frequency/performance
handler.
Is the crash related to CPUsleep states?
Enable features for VM's:
intel_iommu=on -- Used to speed up a VM's access to hardware
iommu=pt" -- Used to speed up a VM's access to hardware
I do not run any VM's, but will this set of options impact the GPU driver
anyway?
Other options:
audit=0 -- Disable various logging features. ?
thermal.off=1 -- Disable ACPI thermal support ?
clocksource=hpet -- Change timers from TSC to HPET (slower) ?
I don't see why any of those options can cause a crash, unless they
generate interrupts somehow. Are they likely to be related to the crash
issue?
GPU driver related options:
amdgpu.vm_fragment_size=9 -- Use 2 MiB page size.
amdgpu.hw_i2c=1 -- Enable temperature sensor?
radeon.clk_support=0 -- Useless?
amdgpu.clk_support=1 -- ?
Only the vm_fragment_size seems relevant, but it seems to be intended to
improve crypto-mining.
So far every crash seems to have happened when I have tried to move the
mouse after writing some text, and all the logs are also related to
moving the mouse. So this is not likely to happen in a mining system at all.
Is the best way to get a stable system to switch to AMDGPU pro with my
setup, or are there other things I can try?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/RadeonOpenCompute/ROCm/issues/368#issuecomment-381602731,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWn0w5IuKSVzGvdVH6gNMMHFtBnh7G0aks5tpJ_ugaJpZM4SyT6L
.

Im building the workstation version of the dev test setup, Would you like
to test it?.  Please contact me directly.
On Mon, Apr 16, 2018 at 9:39 PM, Jason Kurtz<EMAIL_ADDRESS>wrote:

Close it is most likely from, the virtualization in the bios. disable it
vxd..
On Mon, Apr 16, 2018 at 8:43 PM, Runeerle<EMAIL_ADDRESS>wrote:

I have blacklisted the r8169, ppdev and paraport driver, switched to
4.13.0-32-generic and updated to rocm 1.7.137. However there are still
crashes.
It also seems the reason the log is so massive is a grub option
'drm.debug=0xe'.
GRUB_CMDLINE_LINUX_DEFAULT="init=/lib/sysvinit/init apparmor=0
security="" selinux=0 amdgpu.vm_fragment_size=9 nmi_watchdog=0 pti=off 3
spectre_v2=off nospectre_v2 retp=0 ibrs=0 ibpb=0 amdgpu.hw_i2c=1
isolcpus=5,6,7 nohz_full=5,6,7 processor.max_cstate=1 radeon.clk_support=0
amdgpu.clk_support=1 intel_pstate=disable audit=0 thermal.off=1
clocksource=hpet intel_iommu=on iommu=pt"
This seems to be tuned to a custom mining setup. I can not use the grub
line unmodified however. This is my workstation at work, and disabling
security is not a real option.
This set of options disable lots of security features:
apparmor=0 -- Disable normal security
selinux=0 -- Useless on Ubuntu (disable security)
pti=off 3 -- Spectre/Meltdown
spectre_v2=off -- Spectre/Meltdown
nospectre_v2 -- Spectre/Meltdown
retp=0 -- Spectre/Meltdown
ibrs=0 -- Spectre/Meltdown
ibpb=0 -- Spectre/Meltdown
Is it likely these security features impact the crash issue?
This will remove 3 of my 12 CPU threads:
isolcpus=5,6,7 -- Remove CPU 5,6 and 7 from the system :(
nohz_full=5,6,7 -- Set CPU 5,6 and 7 to be in adaptive-ticks mode "reduce
the number of scheduling-clock interrupts" ?
The system is stable with 100% load on all cores for days, and all crash
scenarios have been in ~1-5% load.
More interrupts disabled:
nmi_watchdog=0 -- CPU crash handling (interrupt)
Is the cause related to interrupts?
Disable all CPU energy optimizations:
processor.max_cstate=1 -- Disable all CPU sleep/low-power states.
intel_pstate=disable -- Disable the Intel CPU frequency/performance
handler.
Is the crash related to CPUsleep states?
Enable features for VM's:
intel_iommu=on -- Used to speed up a VM's access to hardware
iommu=pt" -- Used to speed up a VM's access to hardware
I do not run any VM's, but will this set of options impact the GPU driver
anyway?
Other options:
audit=0 -- Disable various logging features. ?
thermal.off=1 -- Disable ACPI thermal support ?
clocksource=hpet -- Change timers from TSC to HPET (slower) ?
I don't see why any of those options can cause a crash, unless they
generate interrupts somehow. Are they likely to be related to the crash
issue?
GPU driver related options:
amdgpu.vm_fragment_size=9 -- Use 2 MiB page size.
amdgpu.hw_i2c=1 -- Enable temperature sensor?
radeon.clk_support=0 -- Useless?
amdgpu.clk_support=1 -- ?
Only the vm_fragment_size seems relevant, but it seems to be intended to
improve crypto-mining.
So far every crash seems to have happened when I have tried to move the
mouse after writing some text, and all the logs are also related to
moving the mouse. So this is not likely to happen in a mining system at all.
Is the best way to get a stable system to switch to AMDGPU pro with my
setup, or are there other things I can try?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/RadeonOpenCompute/ROCm/issues/368#issuecomment-381602731,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWn0w5IuKSVzGvdVH6gNMMHFtBnh7G0aks5tpJ_ugaJpZM4SyT6L
.

Send me a pm on google, I already have a 4.17 live persistant test version
for you to try desktop xubuntu based.
On Mon, Apr 16, 2018 at 9:41 PM, Jason Kurtz<EMAIL_ADDRESS>wrote:

Im building the workstation version of the dev test setup, Would you like
to test it?.  Please contact me directly.
On Mon, Apr 16, 2018 at 9:39 PM, Jason Kurtz<EMAIL_ADDRESS>wrote:

Close it is most likely from, the virtualization in the bios. disable it
vxd..
On Mon, Apr 16, 2018 at 8:43 PM, Runeerle<EMAIL_ADDRESS>wrote:

I have blacklisted the r8169, ppdev and paraport driver, switched to
4.13.0-32-generic and updated to rocm 1.7.137. However there are still
crashes.
It also seems the reason the log is so massive is a grub option
'drm.debug=0xe'.
GRUB_CMDLINE_LINUX_DEFAULT="init=/lib/sysvinit/init apparmor=0
security="" selinux=0 amdgpu.vm_fragment_size=9 nmi_watchdog=0 pti=off 3
spectre_v2=off nospectre_v2 retp=0 ibrs=0 ibpb=0 amdgpu.hw_i2c=1
isolcpus=5,6,7 nohz_full=5,6,7 processor.max_cstate=1 radeon.clk_support=0
amdgpu.clk_support=1 intel_pstate=disable audit=0 thermal.off=1
clocksource=hpet intel_iommu=on iommu=pt"
This seems to be tuned to a custom mining setup. I can not use the grub
line unmodified however. This is my workstation at work, and disabling
security is not a real option.
This set of options disable lots of security features:
apparmor=0 -- Disable normal security
selinux=0 -- Useless on Ubuntu (disable security)
pti=off 3 -- Spectre/Meltdown
spectre_v2=off -- Spectre/Meltdown
nospectre_v2 -- Spectre/Meltdown
retp=0 -- Spectre/Meltdown
ibrs=0 -- Spectre/Meltdown
ibpb=0 -- Spectre/Meltdown
Is it likely these security features impact the crash issue?
This will remove 3 of my 12 CPU threads:
isolcpus=5,6,7 -- Remove CPU 5,6 and 7 from the system :(
nohz_full=5,6,7 -- Set CPU 5,6 and 7 to be in adaptive-ticks mode
"reduce the number of scheduling-clock interrupts" ?
The system is stable with 100% load on all cores for days, and all crash
scenarios have been in ~1-5% load.
More interrupts disabled:
nmi_watchdog=0 -- CPU crash handling (interrupt)
Is the cause related to interrupts?
Disable all CPU energy optimizations:
processor.max_cstate=1 -- Disable all CPU sleep/low-power states.
intel_pstate=disable -- Disable the Intel CPU frequency/performance
handler.
Is the crash related to CPUsleep states?
Enable features for VM's:
intel_iommu=on -- Used to speed up a VM's access to hardware
iommu=pt" -- Used to speed up a VM's access to hardware
I do not run any VM's, but will this set of options impact the GPU
driver anyway?
Other options:
audit=0 -- Disable various logging features. ?
thermal.off=1 -- Disable ACPI thermal support ?
clocksource=hpet -- Change timers from TSC to HPET (slower) ?
I don't see why any of those options can cause a crash, unless they
generate interrupts somehow. Are they likely to be related to the crash
issue?
GPU driver related options:
amdgpu.vm_fragment_size=9 -- Use 2 MiB page size.
amdgpu.hw_i2c=1 -- Enable temperature sensor?
radeon.clk_support=0 -- Useless?
amdgpu.clk_support=1 -- ?
Only the vm_fragment_size seems relevant, but it seems to be intended to
improve crypto-mining.
So far every crash seems to have happened when I have tried to move
the mouse after writing some text, and all the logs are also related
to moving the mouse. So this is not likely to happen in a mining system at
all.
Is the best way to get a stable system to switch to AMDGPU pro with my
setup, or are there other things I can try?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/RadeonOpenCompute/ROCm/issues/368#issuecomment-381602731,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWn0w5IuKSVzGvdVH6gNMMHFtBnh7G0aks5tpJ_ugaJpZM4SyT6L
.

Thank you for closing this, There are some things I Absolutely love and
adore the 64's for, They also make great gifts for linux people I want to
cause night terrors for.
On Sat, May 12, 2018 at 8:11 PM, Gregory Stoner<EMAIL_ADDRESS>wrote:

Closed #368 https://github.com/RadeonOpenCompute/ROCm/issues/368.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/RadeonOpenCompute/ROCm/issues/368#event-1623188603,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWn0w130L-G_yhLbXYxSaoSQsxfIEiq2ks5txt-UgaJpZM4SyT6L
.


RealSense D456 Camera Not Detected

Hello,
I am currently facing an issue with one of two RealSense D456 cameras on a production device at a client site . After a month of normal operation, one camera is no longer detected on the system (Ubuntu 22.04.4 LTS / Kernel 6.8.0-40-generic). Since the camera is installed in another country, remote resolution is crucial, as physical access is not possible.
Here’s a summary of the troubleshooting steps I’ve taken so far:

USB Device Check (lsusb): Only one of the cameras is detected. The same result is observed when using the RealSense Viewer.
Librealsense Reinstallation: I compiled and built librealsense from source (v2.55.1) using a script designed to manage both uninstallation and installation. This script has been successfully tested on other devices with the same setup and is available here: Librealsense Installation Script.
USB Connection Reset: I reset USB connections by unbinding and rebinding PCI USB controllers (/sys/bus/pci/drivers/xhci_hcd) and also triggered a refresh of all USB devices using udevadm trigger. After these resets, still only one camera is recognized. The script used for this process can be found here: USB Reset Script.
High-Quality USB Cables: I am using 1-meter USB cables from Newnex (model U3S1A01C12-12I), cameras are attached directly to the PC.
udev Rules Reset: I reset the udev rules for RealSense by removing the existing rules, reinstalling them from the RealSense SDK, reloading the rules, and rebooting the system.
I tried using sudo shutdown -h now for a full power down to reinitialize the camera, but the PC has an "Auto Boot" feature and causes it to power back on immediately. I'll provide directions to the client on cutting power completely.

Despite these efforts, the issue persists, with this camera remaining undetected while the other functions properly. Both cameras are connected to the same bus, and we have visually confirmed that the problematic camera is securely in place inside our enclosure.
Thank you for your support.

Hi @jrecasens  As you mentioned, unbinding and rebinding xhci_hcd can help, as described at https://github.com/IntelRealSense/librealsense/issues/6899#issuecomment-672293804
Some RealSense users have also found that reboot reliability increases if they enable a feature called Wake On LAN in the computer's BIOS settings.
A user at https://github.com/IntelRealSense/librealsense/issues/5913#issuecomment-590936871 who was deploying hundreds of cameras in the field found that the rtcwake boot method worked well for them, activated with the command below.
rtcwake -m off -s 30
Ultimately, I believe that it is an issue related to the BIOS of the computer, the set of stored configuration settings that are applied immediately after pressing the power button to boot up from a cold start, before the operating system starts loading.  The BIOS that a particular model of computer has depends on the choice made by the manufacturer.

You are very welcome.  Please do let me know if BIOS changes resolve your issue.  Good luck!

Hi @jrecasens  Do you require further assistance with this case, please?  Thanks!

What Always On does, as the name suggests, is to keep the projector in an always-on state.  It does not mean that the emitter will be disabled though if it is false.
On the D415 camera model, the projector is always on.  On the other RealSense 400 Series models though, the emitter instead pulses in line with exposure.  Enabling Always On for the emitter enables it to emulate the always-on behavior of the D415's emitter.  Non-D415 cameras can still function normally though if Always On is off and the projector pulses instead.

Hi @jrecasens  Do you require further assistance with this case, please?  Thanks!

Case closed due to no further comments received.


Ballastic-calc

Fixes Issue🛠

Closes #1856
Description👨💻

Added Ballistic Coefficient Calculator.
Ballistic coefficient calculator is a tool used in ballistics to determine the ballistic coefficient of a projectile, such as a bullet. The ballistic coefficient is a measure of a projectile's ability to overcome air resistance during flight. It is an essential factor in understanding how a projectile will behave over long distances, including its trajectory, velocity, and the degree of wind drift.
Type of Change📄

[x] New feature (non-breaking change which adds functionality)
[x] Style (non-breaking change which improves website style or formatting)
[x] Responsiveness (non-breaking change which improves UI/UX on different screen sizes)

Checklist✅

[x] I am an Open Source contributor
[x] I have performed a self-review of my code
[x] My code follows the style guidelines of this project
[x] I have commented on my code, particularly in hard-to-understand areas

Screenshots/GIF📷


error with tf.app.flags in fully_connected_feed.py

I am getting the following error when I try to use flags. Can you please advise?
Thanks
flags = tf.app.flags
FLAGS = flags.FLAGS
flags.DEFINE_float('learning_rate', 0.01, 'Initial learning rate.')
flags.DEFINE_integer('max_steps', 2000, 'Number of steps to run trainer.')
flags.DEFINE_integer('hidden1', 128, 'Number of units in hidden layer 1.')
flags.DEFINE_integer('hidden2', 32, 'Number of units in hidden layer 2.')
flags.DEFINE_integer('batch_size', 100, 'Batch size.  '
'Must divide evenly into the dataset sizes.')
flags.DEFINE_string('train_dir', 'data', 'Directory to put the training data.')
flags.DEFINE_boolean('fake_data', False, 'If true, uses fake data '
'for unit testing.')
The error is:
usage: main.py [-h] [--learning_rate LEARNING_RATE]
[--max_steps MAX_STEPS] [--hidden1 HIDDEN1]
[--hidden2 HIDDEN2] [--batch_size BATCH_SIZE]
[--train_dir TRAIN_DIR] [--fake_data FAKE_DATA]
[--nofake_data]
main.py: error: unrecognized arguments: -f /Users/sergulaydore/.ipython/profile_default/security/kernel-3561b41d-e378-459a-9e96-5333ea079712.json --profile-dir /Users/sergulaydore/.ipython/profile_default

How are you invoking your script? From the error message, it looks like you are passing -f and --profile-dir flags, but neither of them is defined in your code.

Also, @craigcitro, in case he knows of a way to improve our thin flags wrapper in any way.

In particular, from those flags you're passing, I'm guessing you're trying to do something related to IPython? If so, it's probably possible, but we'd need to know what you were trying to do.
@vrv one option would be to use the parse_known_args method in _flags.py, which would let us parse a set of args but return the remaining ones for the caller to use as they'd like (eg pass them on to ipython). this would be a break from the python-gflags behavior, but possibly useful.

Thank you so much for your answers but I am just learning tensorflow and was trying you run the tutorials. I am just using the script in https://tensorflow.googlesource.com/tensorflow/+/master/tensorflow/examples/tutorials/mnist/fully_connected_feed.py and getting the error above.
Is it possible that there is a bug in the script provided by tensorflow?

What was the command-line you used to invoke it? (Can you give us a pointer to where in the tutorial you were?)

So, I was going through this tutorial: https://www.tensorflow.org/versions/master/tutorials/mnist/tf/index.html#tensorflow-mechanics-101 and I got an error when reading the data which was
data_sets = input_data.read_data_sets(FLAGS.train_dir, FLAGS.fake_data)
It works fine if I just enter the directory instead of FLAGS.train_dir.

Oh, I see -- are you just following the tutorial from within IPython?

Exactly! Is that wrong? Should I run from Python shell?

Well, I think it just means that we didn't anticipate that use case, but should have. :wink: As a short-term workaround, running from the python command-line should get you fixed up.
@vrv it looks like we're going to need something like the fix I was talking about above.

Indeed it worked in IPython command line :) Thank you very much!

I think I fixed this in 1c579361cd1e088dd5e05a394b1561a73e3667ba


Global Install

Had a note to investigate this
https://tommcfarlin.com/globally-installing-wp-cli/

@indrisepos I'm not sure what the above is for?


Resolve gem version conflicts with Hyrax v4

Story
Attempting to add Bulkrax to a Hyrax v4 application fails due to gem version errors. Specifically, for the dry-monads and bagit gems.
dry-monads error message
Could not find compatible versions

Because every version of bulkrax depends on dry-monads ~> 1.4.0
  and every version of hyrax depends on dry-monads ~> 1.5,
  every version of bulkrax is incompatible with hyrax >= 0.
So, because Gemfile depends on hyrax >= 0
  and Gemfile depends on bulkrax >= 0,
  version solving has failed.

bagit error message
Your bundle is locked to bagit (0.4.6) from rubygems repository
https://rubygems.org/ or installed locally, but that version can no longer be
found in that source. That means the author of bagit (0.4.6) has removed it.
You'll need to update your bundle to a version other than bagit (0.4.6) that
hasn't been removed in order to install.

These errors occurred on the following versions:

Hyrax: d0bd18b34021e18984b3bb632260722adb8fed26
Bulkrax: e6f2cf94730ea7db236a6f3280d3dc3967f5495e

Resolving these errors is the first step in making Bulkrax compatible with Hryax v4 and is blocking many following tasks.
Acceptance Criteria

[ ] Bulkrax successfully bundles in a Hyrax v4 app
[ ] Resolutions are backwards-compatible with previous Hyrax versions 2.x and 3.x (if possible)

Testing Instructions
NOTE: These instructions assume you will be using Hyrax's .koppie app. They should apply to any Hyrax v4 app, but if you aren't using .koppie, you may need to slightly modify some of the commands.
NOTE: If using .koppie for testing purposes, you will need to add libxml2-dev to the EXTRA_APK_PACKAGES variables in both Dockerfile and docker-compose-koppie.yml and rebuild the Docker image. See this PR for an example.

Add gem 'bulkrax' to .koppie/Gemfile
Run docker compose -f docker-compose-koppie.yml up
Ensure all containers run with no bundler errors. Visit http://localhost:3001 to make sure the app spins up successfully.

Notes
The official bagit gem does not support Ruby 3.2, which Hyrax v4 requires. I found a fork that does support Ruby 3.2:

https://github.com/phigrofi/bagit
https://github.com/tipr/bagit/pull/48

If this fork is used, testing should be done to ensure the Bagit importer still works as expected.
Related conversation in Slack: https://samvera.slack.com/archives/C03S9FS60KW/p1688779291516519

For what its worth, my understanding is that hyrax 4 only requires ruby >= 2.7, but their test matrix tests through 3.2. Hyrax 5 does require 3.2 though.
For our local repository, forking bulkrax and changing to s.add_dependency 'dry-monads', '~> 1.5.0' seems to resolve dependency issues when including bulkrax 5.3.0 in a hyrax 4 based repository using ruby 2.7 (oddly 5.2.1 did not have problems being included in the hyrax 4 based repo). Of course all the tests fail in bulkrax due with uninitialized constant Dry::Monads::Result::Transformer.  I get the impression that dry-transactions v0.15.0 is supposed to resolve this issue https://github.com/dry-rb/dry-transaction/commit/4fbe3aea30e4293fceba74c6204ec82d993957e6 but if I set that in bulkrax then bundle update spins forever.
In actual usage in our repository, Bulkrax seems to be functioning and I'm able to do a a csv based import of several dozen works, and then export it.
It also looks like since this issue was opened, the official bagit gem has released an update (0.4.6) with ruby 3.2 support.

This is great, thanks for the info @bbpennel!


[Mobile] Failed assertion: line 30 pos 12: 'value.isInline || value.isIgnored || value.isEmpty'

My issue is about [Mobile]
When copying and pasting from Wikipedia to Quill, you can get the following op:
    {
      "attributes": {
        "script": "super",
        "color": "#0645ad",
        "background": "initial",
        "link": "https://ru.wikipedia.org/wiki/%D0%A0%D0%BE%D0%B4%D0%B8%D0%BE%D0%BD_%D0%A0%D0%B0%D1%81%D0%BA%D0%BE%D0%BB%D1%8C%D0%BD%D0%B8%D0%BA%D0%BE%D0%B2#cite_note-_37a3407c9d29c9c4-2"
      },
      "insert": "[2]"
    },

And got
 assert(value.isInline || value.isIgnored || value.isEmpty,
        'Unable to apply Style to leaf: $value');

The problem is in the script attribute, it is ignored by flutter_quill, but combined with other attributes.
  bool get isInline => isNotEmpty && values.every((item) => item.isInline);

  bool get isIgnored =>
      isNotEmpty && values.every((item) => item.scope == AttributeScope.IGNORE);

Flags in assertion are formed through every, that is, all attributes should be ignored or not. Not sure, but it might be worth changing this check so that ignored attributes are ignored and only inline affects the styling?

Could you submit a PR?


Tracking Issue: Exposing RUSTFLAGS in cargo

RUSTFLAGS is a low level mechanism

Harder for users to discover features
Harder for cargo to reason about like in #5931

This is meant to track RUSTFLAGS that should have a cargo-native way of being exposed.  This won't always be one-to-one mappings

[x] --allow, --deny, --warn

Use case: package-level control over warnings
#12115

[ ] --allow, --deny, --warn

Interactively denying/allowing warnings
#8424

[ ] --target-cpu=native

#2535

[ ] --cfg

https://internals.rust-lang.org/t/pre-rfc-mutually-excusive-global-features/19618

[ ] -Cinstrument-coverage

#13040

See also

https://rust-lang.zulipchat.com/#narrow/stream/246057-t-cargo/topic/Reasons.20people.20use.20RUSTFLAGS
https://rust-lang.zulipchat.com/#narrow/stream/246057-t-cargo/topic/Per-user.20build.20caches

@epage is this the same as people always discuss when finding the config language toml is ok, but not ideal? compared to:

ron: https://github.com/ron-rs/ron
cuddle: https://kdl.dev
dhall: https://dhall-lang.org/

This issue is about finding ways to expose environment config as project config and is unrelated to what format is used for either

Would it make sense to support arbitrary unstable rustc flags, which are project-specific or profile-specific?
For example, there's -Z location-detail=none that I'd like to set in release profile.
Cargo probably won't rush to add first-class options for rustc features that haven't been stabilized yet. OTOH without Cargo's help, they still require RUSTFLAGS.
Maybe something like:
cargo-features = ["unstable"]

[profiles.release]
unstable = {
    location-detail = "none"
}

Would profile rustflags be a way of handling this since you are already using unstable features anyways?
This issue is more about how to create abstractions for uses of rustflags.  Creating another pass-through mechanism doesn't seem in the spirit of this issue.

Some perspective from various production projects:

having only the [lints] table and no command-line options is not sufficient - there's a use case when one wants to simply check if a crate uses unsafe to decide whether it's worth running miri on the crate or not. This also implies that --forbid is needed. (The check is cargo check with -F unsafe-code and if it fails run miri, skip otherwise.)
Generally, it's not sufficient to have something configurable via Cargo.toml because CI might need to change things and patching a toml to do that is fragile.
Limiting --target-cpu to just native sounds strange, but thankfully not my problem (yet)
When testing code under miri one often wants to enable target-features to make sure unsafe SIMD code gets checked. And because maintaining lists of features to enable is tiresome, the straightforward approach is to enable everything except crt-static. --enable-all-simd-target-features would be nice.
--cfg, definitely, this is a big one. Not just for mutually exclusive features but also for various debugging purposes. Also it's weird that cargo bench does not set bench cfg already.
-C link-arg selecting a linker script is needed for embedded (but maybe there are better ways?)
Sanitizers, obviously, often used with force-frame-pointer=yes
Linker selection


UVI Request

--- UVI JSON ---
{
  "vendor_name": "Linux",
  "product_name": "Kernel",
  "product_version": "versions from  to before v5.4.162",
  "vulnerability_type": "unspecified",
  "affected_component": "unspecified",
  "attack_vector": "unspecified",
  "impact": "unspecified",
  "credit": "",
  "references": [
    "https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/commit/?id=d491c84df5c469dd9621863b6a770b3428137063"
  ],
  "extended_references": [
    {
      "type": "commit",
      "value": "d491c84df5c469dd9621863b6a770b3428137063",
      "note": "fixed"
    }
  ],
  "reporter": "joshbressers",
  "reporter_id": 1692786,
  "notes": "",
  "description": "tty: tty_buffer: Fix the softlockup issue in flush_to_ldisc\n\nThis is an automated ID intended to aid in discovery of potential security vulnerabilities. The actual impact and attack plausibility have not yet been proven.\nThis ID is fixed in Linux Kernel version v5.4.162 by commit d491c84df5c469dd9621863b6a770b3428137063. For more details please see the references link."
}
--- UVI JSON ---

This issue has been assigned UVI-2021-1002267


Can't reuse http::response< http::string_body >

Hello,
Looks like http::response body not cleared during executing http request. Is it expected behaviour? Is http::response<...> is reusable object?
Thanks

Are you asking if beast::http::write clears the body after sending the message? No, it does not. The function accepts a const&, it cannot modify the message.
Why do you want to clear the message? Maybe its something I can add. If you want to reuse the variable you could put it in a boost::optional and just emplace it every time you want to use it.

@vinniefalco thanks, boost::optional is solution for me


Mlflow is exposed with basic authentication without TLS

The gcp-kubeflow-kserve stack recipe deploys the mlflow tracking server which is exposed with a Nginx Ingress. The deployed tracking server is configured to use only basic authentication (username + password) but does so over plain http without TLS encryption. This is dangerous (see here, here) since the credentials which are sent with every request when using basic auth are then not encrypted.

Hi @fg91! Thanks for raising concern on the security of the MLflow tracking server. Right now, the setup is very basic as you pointed out but I'm open to hearing any suggestions you have to make it better.


[base-ui][Autocomplete] useAutocomplete hook disabled option can be clicked

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Steps to reproduce 🕹
Link to live example: https://codesandbox.io/s/compassionate-chatelet-qz92q4?file=/Demo.tsx
Steps:

Have an autocomplete hook with the getOptionDisabled option working
Pass some disabled option
Click the disabled option

Current behavior 😯
The disabled option can be clicked, even though if inspected, it has aria-disabled="true" attribute.
Expected behavior 🤔
The option should not be clickable.
Context 🔦
I'm creating a custom Autocomplete input with the useAutocomplete hook, but this is failing on my tests.
Your environment 🌎

npx @mui/envinfo
  System:
    OS: macOS 13.5.1
  Binaries:
    Node: 18.12.1 - /usr/local/bin/node
    Yarn: 1.22.19 - ~/.npm-global/bin/yarn
    npm: 8.19.2 - /usr/local/bin/npm
  Browsers:
    Chrome: 116.0.5845.96 <-- tested here
    Edge: 114.0.1823.55
    Safari: 16.6

@phiter Thanks for reporting this ~ I agree it's a little unintuitive 😅
When we use this hook to make the Material UI and Joy UI autocomplete components, we use pointer-events: none to prevent the click (here)
Here's an example with just Base UI: https://codesandbox.io/s/https-github-com-mui-material-ui-issues-38620-77j4gk?file=/Demo.tsx
@michaldudak Do you think preventing selecting a disabled option could be provided out of the box?

@mj12albert I tried pointer-events: none at first but since I use @testing-library/user-events, it doesn't immediately perform clicks on elements with pointer-events: none. When I disabled this check, the click event triggered. I don't know if simply trusting CSS is a good option, because the user can disable pointer-events: none in the devtools and the function will execute if it isn't handled.
I ended up having to do this in my code 😬
{(groupedOptions as T[]).map((option, index) => {
    const optionProps = getOptionProps({ option, index });
    // Workaround until https://github.com/mui/material-ui/issues/38620 is fixed
    const isDisabled = autoCompleteOptions.getOptionDisabled(option);

    return (
        <AutocompleteOption
            key={index}
            {...optionProps}
            onClick={isDisabled ? undefined : optionProps.onClick}
        >
            {option.name}
        </AutocompleteOption>
    );
})}

I suppose it could be an option for the hook, like enableDisabledOptionClickHandler or something like that.
There is no handling in the code:
https://github.com/mui/material-ui/blob/8f5ff618ba8ec5d25c82fb8c5f67f9325a41bb3b/packages/mui-base/src/useAutocomplete/useAutocomplete.js#L998-L1003
https://github.com/mui/material-ui/blob/8f5ff618ba8ec5d25c82fb8c5f67f9325a41bb3b/packages/mui-base/src/useAutocomplete/useAutocomplete.js#L1157-L1175

Same

Do you think preventing selecting a disabled option could be provided out of the box?

Yes, I think it should work similarly to how Base UI's Select works (likely using the same primitives).


torchrec.inference.modules.quantize_embeddings does not seem to quantize weights.

I tried to quantize my EBC in 3 different ways.  None of them changed the dtype of the weights.  Perhaps I'm misunderstanding when quantization happens?
import torch
import torch.quantization as quant
import math
import torchrec
from torchrec.modules.embedding_configs import EmbeddingBagConfig
from torchrec.modules.embedding_modules import EmbeddingBagCollection

eb_configs = [
    EmbeddingBagConfig(
        name=f"t_{feature_name}",
        embedding_dim=256,
        num_embeddings=1024,
        feature_names=[feature_name],
    )
    for feature_idx, feature_name in enumerate(
        ['feature0', 'feature1',]
    )
]
ebc = EmbeddingBagCollection(tables=eb_configs, device='cuda')

from torchrec.sparse.jagged_tensor import KeyedJaggedTensor
features = KeyedJaggedTensor(
  keys=["feature0", "feature1"],
  values=torch.arange(1024).cuda(),
  lengths=torch.ones(1024).int().cuda(),
)

ebc(features).values()
print({key: value.dtype for key, value in ebc.state_dict().items()})

qebc = quant.quantize_dynamic(ebc, inplace=False)
qebc(features).values()
print({key: value.dtype for key, value in qebc.state_dict().items()})

from torchrec.inference.modules import quantize_embeddings
tr_qebc = quantize_embeddings(ebc, dtype=torch.qint8, inplace=False)
print({key: value.dtype for key, value in tr_qebc.state_dict().items()})

All the prints here output
{'embedding_bags.t_feature0.weight': torch.float32, 'embedding_bags.t_feature1.weight': torch.float32}

Hey @rllin, it seems like quantize_embeddings and quantize_dynamic only apply to submodules. With a wrapper module ebc = torch.nn.Sequential(ebc) I get:
{'0.embedding_bags.t_feature0.weight': torch.uint8, '0.embedding_bags.t_feature1.weight': torch.uint8}

Interesting, definitely not the best user experience,
@s4ayub @zyan0 do you know why it's not applying quantization correctly to a top level EBC?

The quantize_dynamic doc does seem to specify that it applies to submodules, not sure why they have this restriction:
https://pytorch.org/docs/stable/generated/torch.quantization.quantize_dynamic.html

@yifuwang thank this works!


Xsv xls should probably skip empty lines at the beginning and at the end

At the beginning it’s trivial. At the end less so.
But we might want to buffer all the rows into memory anyway (I don't think the format is streamable), to trim lines at the end and perform header padding etc. to avoid issues with weirdly formatted sheets.

All of this is already taken care of by calamine.


vbus request failed!

I'm getting a message saying vbus request failed. I can bypass it and control the motor normally using the code in the example sketch.
I am using a Teensy4.1 with an odrive S1.
Example output:
14:15:35.910 -> Starting ODriveCAN demo
14:15:37.900 -> Waiting for ODrive...
14:15:38.129 -> found ODrive
14:15:40.115 -> attempting to read bus voltage and current
14:15:41.125 -> vbus request failed!
14:15:41.125 -> DC voltage [V]: 0.00
14:15:41.125 -> DC current [A]: 0.00
14:15:41.125 -> Enabling closed loop control...
14:15:41.418 -> ODrive running!
14:15:41.418 -> odrv0-pos:-0.00,odrv0-vel:0.01

Does the request fail every time (e.g. when you run it in a loop)?
If you bypass the check, does it correctly print continuous pos/vel feedback?
Do you have a CAN logger available that you could connect to this bus? (e.g. a host PC with a CAN interface or CAN dongle, and can_logger from python-can)


No events being sent. What is the format expected by "DSN"?

We have installed sentry in 3 kubernetes clusters, using
helm install \
    incubator/sentry-kubernetes \
    --name sentry\
    --namespace sys \
    --set rbac.create=false \
    --set<EMAIL_ADDRESS>
None of the projects is receiving any data.
Container produces no log to stdout.
Any ideas on how to troubleshoot the setup?
Also, can anyone confirm the DNS format is correct or if it needs to be one of the alternatives ?

<EMAIL_ADDRESS><EMAIL_ADDRESS>something else
Thx

Everything seems to be working fine... Would be nice to have some of output on sentry pod on start and/on or initial connection to sentry.

@joaocc so which DSN format was the correct one?


[Feature][flink-kubernetes-operator] extends flink-kubernetes-oprator image

Already searched before asking?

[X] I had searched in the feature and found no similar feature requirement.

Usage Scenario
extends flink-kubernetes-oprator image
Description

[ ] enable scaleph supported FileSystem to support session job. refer FlinkSessionJob spec overview
[ ] add plugins to listen job event. refer Custom Operator Plugins

Are you willing to submit a PR?

[ ] Yes, I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

add postStart for flink kubernetes operator to install hadoop-aws FileSystem #729

add postStart for flink kubernetes operator to install hadoop-aws FileSystem #729

not used, myst extends flink-kubernetes-operator image


fix: table moves up when doing selection

Head:
when a focused cell is updated, the scroll position is updated accordingly.

Current:
only when using the keyboard to move up, the scroll position is updated accordingly
https://user-images.githubusercontent.com/4471489/183973096-02159b34-3100-4c7b-80e1-58b718798e20.mov
Limitation:
For a very narrow table, the best we can do is that arrow up scroll behavior is the same as the arrow down scroll behavior
Head:
https://user-images.githubusercontent.com/4471489/183924745-1f1c290b-405a-46bb-8bf1-590a0b49d4ef.mov
Current:
https://user-images.githubusercontent.com/4471489/183974003-9cf9f391-8441-4fa5-82d9-12afa8a91673.mov

If I understand the limitation, it only happens when your header is bigger than the whole body. Should be a really uncommon use case

Right, an uncommon one, and it is good that we know it in advance.

Really nice that we could solve this without introducing forwardRef, great work


Xtce generator updates

Change Summary
Overview
Refactored XTCE generator code to work with different dataType and remove needing to specify specific mnemonic.
New Files

Create xtce_generator_template.py that we can use to generate any number of XTCE for any instrument.

Deleted Files

Deleted files from imap_processing/codice/L0 folder which are being replaced by xtce_generator_template.py

Updated Files

moved xml files from imap_processing/packet_definitions into their instrument folder
tools/xtce_generation/ccsds_header_xtce_generator.py. Updated unint to UINT
tools/xtce_generation/telemetry_generator.py

main refactor in this PR happened in this file

I am assuming that we will build documentation for how to use this?

pre-commit.ci autofix


Add auto completion

Use CompletionItemProvider  API

Refs:
https://github.com/microsoft/vscode-extension-samples

https://gist.github.com/SamVerschueren/1445f843034bf6826bb0eed696c406ec

https://vshaxe.github.io/vscode-extern/vscode/CompletionItem.html

Still not perfect.


Master

Before submitting a pull request, make sure it's targeting the right branch:

For documentation fixes, use master.
For bug fixes or new features compatible with the next version, use develop.
For bug fixes incompatible with develop, use the support branch of the latest compatible version, which will be formatted support/6.x.

If you're fixing a JavaScript issue, it would help to create a new test case under the folder test/visual/ that recreates the issue and show's that it's been fixed. Run npm test to compile the testing folder.
Happy coding! :)

Seems like you by mistake added these changes .... Closing this but if you need any help on how to do a Pull Request, please feel free to revert!


Modify the create collection endpoint to add DOI constraints

See epic description for the full details, but these are the requirements:

Replace the DOI link with Publication DOI to clarify our intentions.
Replace the full URL with a DOI curie
Only allow one Publication DOI link to be added to the collection

Covered by #1804.


Producer only attributes

This commit implements the last 2 steps of the better attribute matching strategy story.
It's still WIP, please do not merge as is.
See https://github.com/gradle/performance/issues/86#issuecomment-259608992

@oehme I have pushed several commits to fix the review items. Let me know.

Exception renamed. Tx for the review!


Add support for upstream Storm on Python 3

Storm is maintained again (mostly by me at the moment) and supports Python 3, so test flask-storm with it.

Thank you for this. I've reviewed the changes and they look good to me.


Improve the Error handling in the getCalendarYear method

Right now, the getCalendarYear method will return an object if there is an error:
 return {
      error: {
        body: 'The argument passed to `calendar(\'YYYY\')` must be a valid year between 1900 and 2100. You passed ' + year + '.'
      }
    };

This object is inconsistent with the rest of our error handling, This ticket is being created to change the error response. It should probably be something more like:
throw new TypeError('The argument passed to `calendar(\'YYYY\')` must be a valid year between 1900 and 2100.');

This will likely break some tests in the workspaces/tests directory. Please attempt to fix those errors as they arise, if you encounter troubles, feel free to reach out - I'm happy to help 🙂

this issue was resolved in PR #99 alongside issue #81


About training paramters

Describe the issue or your query
Insert a clear and concise description of what the issue is including any steps to reproduce and/or relevant script output.
Computing Environment (please complete the following information):

OS: Windows 7 Enterprise

Tensorflow Version:  Tensorflow-gpu 1.12

OpenCV Version: 4.2.0

alternative machine learning environment / toolkit (if applicable): [e.g. keras, pytorch + version]

Additional context
I'm trying to reproduce your result of fireNet in your paper but the highest accuracy I got from your testing set is only 91%. I have some questions:

Did you use the same optimizer in fireNet.py file to produce that result? (93% as described).
Did you use other image processing or augmentation parameters? If the answer is yes, can you provide it?
Is it effective if I use this model to classify whether a small flame in a picture, such as a active gas stove in a kitchen? (of course the same data will appear in the training set)
Thank in advance.

Did you use the same optimizer in fireNet.py file to produce that result? (93% as described).

Yes, and we have independently repeated this in a later paper based on the same code base - https://arxiv.org/abs/1911.09010
Different authors, different hardware environment, same dataset, same training optimization ... same results.
There is always some randomisation in CNN training due to the random initialisation of weights and the stochastic nature of backpropagation. I note so you are using a different operating system environment to that originally used, which will of course have a a difference in the the underlying GPU software stack.

Did you use other image processing or augmentation parameters?

No but I note that as per the FAQ we did not normalise our pixel values to the range 0 to 1 and we used BGR channel ordering, the OpenCV default, rather than RGB channel ordering for the training - this will vary depending on the data loader in use.

Is it effective if I use this model to classify whether a small flame in a picture, such as a active gas stove in a kitchen?

Yes this should be possible. I would suggest training on examples of this type of flame, potentially using transfer learning have a pretrained on the dataset provided.
Hope this helps.

I noted that you has implement a new network based on ResNet architecture, but seem that the kink download the new paper is no longer. Can you share me your research or the architecture of that network?

Which link is that ? .. our paper shows other models outperform ResNet
Experimental Exploration of Compact Convolutional Neural Network Architectures for Non-temporal Real-time Fire Detection (G. Samarth, N. Bhowmik, T.P. Breckon), In Proc. Int. Conf. on Machine Learning Applications, IEEE, 2019. -  https://arxiv.org/abs/1911.09010
Provisional unsupported code is available in this branch - https://github.com/tobybreckon/fire-detection-cnn/tree/icmla - , without an updated README at present but the updated download scripts grab the new data and models for ..OnFireV3 / ..OnFireV4 ... I am still to find time to merge this into main.
Hope this helps.

Sorry for my mistake. I saw your work and will train 2 new model. I hope I can archive your described result.


tft-erc20 deployment

[ ] Multiple light clients from the same external ip does not work

[x] Create an flist for an ethereum full node

[x] package a startup script
[x]  publish it to tf_official apps

[x] deploy full node for testnet

[x] deployment of ethereum full node fails to run
[x] convert cli status command on testnode to JSON RPC

[ ] Enable ethvalidation on the testnet nodes that create blocks

[x] [Can't set custom eth bootnodes in tfchain templates]
(https://github.com/threefoldfoundation/tfchain-templates/issues/4)
[ ] [Zrobot only checks out master repo for templates when booting]
(https://github.com/threefoldtech/0-robot/issues/66)
[x] Can't get proper bootnode url from geth

[x] blockcreator with ethvalidation and unencrypted wallet is not creating blocks
[x] Initially adding the supplied bootnodes once seems not good enough
[x] Block creator template can't be started

➤ Lee Smet commented:
deplying a geth instance led to the following error:
In [25]: geth = robot.services.create(GETH_ID, 'testnet_geth', data)
LoopExit                                  Traceback (most recent call last)
/usr/local/bin/js_shell in ()
----> 1 geth = robot.services.create(GETH_ID, 'testnet_geth', data)
/opt/code/github/threefoldtech/0-robot/zerorobot/dsl/ZeroRobotManager.py in create(self, template_uid, service_name, data, public)
171             raise ServiceCreateError(e['message'], err)
172
--> 173         return self._instantiate(new_service)
174
175     def find_or_create(self, template_uid, service_name, data, public=False):
/opt/code/github/threefoldtech/0-robot/zerorobot/dsl/ZeroRobotManager.py in _instantiate(self, data)
48     def _instantiate(self, data):
49         if hasattr(data, 'secret') and data.secret:
---> 50             self._client = config_mgr.append_secret(self._client.instance, data.secret)
51             # force re-creation of the connection with new secret added in the Authorization header
52             self._client._api = None
/opt/code/github/threefoldtech/0-robot/zerorobot/dsl/config_mgr.py in append_secret(self, instance, secret)
114
115     def append_secret(self, instance, secret):
--> 116         return self._send_cmd(self._append_secret, [instance, secret])
117
118     def remove_secret(self, instance, service_guid):
/opt/code/github/threefoldtech/0-robot/zerorobot/dsl/config_mgr.py in _send_cmd(self, func, args)
36         resp_q = Queue(maxsize=1)
37         self._queue.put((func, args, resp_q))
---> 38         resp = resp_q.get()
39         if isinstance(resp, Exception):
40             raise resp
/usr/local/lib/python3.5/dist-packages/gevent/_queue.cpython-35m-x86_64-linux-gnu.so in gevent._queue.Queue.get()
/usr/local/lib/python3.5/dist-packages/gevent/_queue.cpython-35m-x86_64-linux-gnu.so in gevent._queue.Queue.get()
/usr/local/lib/python3.5/dist-packages/gevent/_queue.cpython-35m-x86_64-linux-gnu.so in gevent._queue.Queue.__get_or_peek()
/usr/local/lib/python3.5/dist-packages/gevent/__waiter.cpython-35m-x86_64-linux-gnu.so in gevent.__waiter.Waiter.get()
/usr/local/lib/python3.5/dist-packages/gevent/__greenlet_primitives.cpython-35m-x86_64-linux-gnu.so in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch()
/usr/local/lib/python3.5/dist-packages/gevent/__greenlet_primitives.cpython-35m-x86_64-linux-gnu.so in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch()
/usr/local/lib/python3.5/dist-packages/gevent/__greenlet_primitives.cpython-35m-x86_64-linux-gnu.so in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch()
src/gevent/__greenlet_primitives.pxd in gevent.__greenlet_primitives._greenlet_switch()
LoopExit: This operation would block forever
Hub: <Hub '' at 0x7f2cfc12c978 epoll pending=0 ref=0 fileno=17 thread_ident=0x7f2d11f41700>
Handles:
[]which seems to have left the robot in an inconsistent state. The service is not listed, but trying to create a  new service with the same name fails because the name is supposedly already taken. At this point, the robot is not even starting because it does not have the templates for this service after a restart somehow.

➤ Lee Smet commented:
full node is now running for testnet

➤ Lee Smet commented:
While testing the new template version, the node lost internet access for no apparent reason. While trying to solve this the node was rebooted, but internet connectivity still did not work, so the node is failing to boot as a result now.

➤ Lee Smet commented:
geth deployed and now syncing

➤ Lee Smet commented:
Yesterday some bugs were discovered and fixed, however the geth node needs to sync again as the progress was lost due to one of these bugs

➤ Lee Smet commented:
Seems like the current way the ethbootnodes are added does not allow us to connect to the ethereum full node

➤ Lee Smet commented:
Seems to work on
a local node with https://github.com/threefoldfoundation/tfchain/commit/239f9e755eb31b9e4b04a332e0d36a2cb40e9c07

➤ Lee Smet commented:
Did some changes to the way the flists are build, now getting the following build errors:
github.com/mholt/caddy/caddytls
/root/go/pkg/mod/github.com/mholt/caddy@v0.11.5/caddytls/setup.go:174:28: cannot use value (type "github.com/xenolf/lego/certcrypto".KeyType) as type "github.com/go-acme/lego/certcrypto".KeyType in assignment
/root/go/pkg/mod/github.com/mholt/caddy@v0.11.5/caddytls/setup.go:354:4: cannot use config.Manager.KeyType (type "github.com/go-acme/lego/certcrypto".KeyType) as type "github.com/xenolf/lego/certcrypto".KeyType in field value

➤ Lee Smet commented:
tfchain autobuilder is now working correctly again

➤ Lee Smet commented:
now blocked on https://github.com/threefoldfoundation/tfchain-templates/issues/11

➤ Lee Smet commented:
Block creator now running, connected to our geth through the zerotier address, and seems to be sycning
In [67]: con.client.system('/bin/tfchainc erc20').get()
Out[67]:
STATE: 0 SUCCESS
STDOUT:
Starting block height: 4587519
Current block height: 4613823
Highest block height: 5390531
STDERR:
DATA:

➤ Lee Smet commented:
validation daemon won't progress past block 193,605


Update homepage carousel

Some feedback on the carousel we'd like to address:

Navigation buttons are too far away, it's not obvious that these control it
Nav buttons disconnected from the scrollbar
We should make it more clear that it's a primary sale.

Requires design.

Approved Designs


[Chore] Remove Attributes for 'Categories' in Landing Page Footer

Category

[ ] Resource Addition
[ ] Documentation
[x] Codebase
[ ] User Interface
[ ] Feature Addition

Description

We need to remove the attributes for 'Categories' in the landing page footer.
To do this, remove the id and style attributes from the following code in 'client/components/footer.js':

Categories

Hello! May I take this?

Sure, @srodif!


High resolution regions do not appear on global plots

I have a Gulf of Mexico regionally refined mesh with 1.25 million horizontal cells. About 300-400k cells are in the GoM. When I do a global plot of a variable, the GoM is missing. Below shows an example with  cellQuality on the base mesh. The problem shows up on the culled mesh with most variables too, such as cellWidth. If I zoom in to the GoM, the values are visible though.
Any idea why this is happening or how to fix it?

Hey @dylanschlichting!
Thanks for using mosaic and putting it through it's paces! Depending on how this initial round of questions goes, I think the easiest thing would be if I can start playing around with the mesh myself.  Using the developer install instruction from the readme? Or did you happen to install it directly from conda forge?

What do you expect the values for cell quality to be in the GoM? I'm sure this isn't the problem, but have you tried reversing the colormap? (Something like "reds_r", based on what you've got there. Or maybe something like "viridis"). I wonder if all the cells have a pretty low value ~0.5 then zoomed out at this scale they overlay with each other to make what looks like missing data. That's probably not the case but worth a quick check.

Could you elaborate more about what you mean by:

If I zoom in to the GoM, the values are visible though.

A screenshot or something of the zoomed in region and what it looks like would be super helpful.

Could you share the code snippet you used to make plot? Don't need anything about processing the data, but figure/axes creation, initializing the descriptor, and the plot commands would be useful for debugging.

Hey Andrew,
I installed mosaic through the developer install instructions from the readme. This appears to be a jupyter problem, when I save the figure via python script it works. Shown below are the global & zoomed in plots. As you can see, not a colormap problem.
My guess is that this is due to the huge number of cells concentrated in a small area, so Jupyter is having problems displaying it. I have not had this problem with other meshes yet, but this mesh is unprecedented. Maybe the best option is to add a warning to future documentation that describes this issue. That is, if high resolution regionally refined regions aren't rendering in Jupyter, just save the figure?

import numpy as np
import xarray as xr
import mosaic
import cartopy
import cartopy.crs as ccrs
from cartopy.mpl.gridliner import LONGITUDE_FORMATTER, LATITUDE_FORMATTER
import cartopy.feature as cfeature
import cmocean.cm as cmo
import matplotlib.pyplot as plt

ds = xr.open_dataset('/lustre/scratch5/dschlichting/runs/gom1pt5r2/ocean/global_ocean/GoM5/mesh/base_mesh/base_mesh.nc')

lat = np.degrees(ds.variables['latCell'][:])
lon = np.degrees(ds.variables['lonCell'][:])

crs = ccrs.PlateCarree()
projection = crs
transform = ccrs.PlateCarree()

# Plot the cell quality for the whole globe
land = cfeature.NaturalEarthFeature('physical', 'land', '110m',
                                edgecolor='face',
                                facecolor=cfeature.COLORS['land'])
crs = ccrs.PlateCarree(central_longitude=0)

fig, ax = plt.subplots(1, 1, figsize=(9,4),
                       constrained_layout=True,
                       subplot_kw=dict(projection=projection))

descriptor = mosaic.Descriptor(ds, projection, transform)
m1 = mosaic.polypcolor(ax, descriptor, ds.cellQuality,
                       antialiaseds=False, cmap = cmo.amp,
                       vmin = 0.5, vmax = 1)
fig.colorbar(m1, ax = ax, label = r'Cell quality', pad = 0.02)

ax.add_feature(land, facecolor='0.8')
ax.coastlines(resolution='10m', linewidth = 0.65)

gl = ax.gridlines(linewidth=0.75, color='black', alpha=0.5,
                  linestyle='dotted', draw_labels=True)
gl.xformatter = LONGITUDE_FORMATTER
gl.yformatter = LATITUDE_FORMATTER
gl.right_labels = False
gl.left_labels = True
gl.top_labels = False
gl.bottom_labels = True

ax.set_title(r'Cell quality')
fig.canvas.draw()
plt.savefig('gom1pt5_cellqual_globe.jpg', dpi = 300)

# Plot the cell quality for the GoM
fig, ax = plt.subplots(1, 1, figsize=(7,4),
                       constrained_layout=True,
                       subplot_kw=dict(projection=projection))

descriptor = mosaic.Descriptor(ds, projection, transform)
m1 = mosaic.polypcolor(ax, descriptor, ds.cellQuality,
                       antialiaseds=False, cmap = cmo.matter,
                       vmin = 0.5, vmax = 1)
fig.colorbar(m1, ax = ax, label = r'Cell quality', pad = 0.02)

ax.set_extent([-110, -79.9, 10, 31], ccrs.PlateCarree())
ax.add_feature(land, facecolor='0.8')
ax.coastlines(resolution='10m', linewidth = 0.65)

gl = ax.gridlines(linewidth=0.75, color='black', alpha=0.5, linestyle='dotted', draw_labels=True)
gl.xformatter = LONGITUDE_FORMATTER
gl.yformatter = LATITUDE_FORMATTER
gl.right_labels = False
gl.left_labels = True
gl.top_labels = False
gl.bottom_labels = True

ax.set_title(r'Cell quality')
fig.canvas.draw()
plt.savefig('gom1pt5_cellqual_zoom.jpg', dpi = 300)

Sweet! Happy to hear there's an easy fix. I have to admit I don't use jupyter notebooks much these days, so it's not a surprise this issue slipped under the radar until now. That being said, I know jupyter notebooks are super popular especially when it comes time to do analysis, so we will want to try support notebooks as much as we can.
Have you used X11 windows forwarding much? If not it's really easy, all you need to do is add an -XY to you ssh command when you login to the cluster, so something like ssh -XY .... It would be super helpful if you could run the code above as a standalone script, with a plt.show() added to the bottom of the file. It'd be useful to know if the rendering problem is for all backends (including the interactive), or just happens to be a jupyter notebook backend problem.

@dylanschlichting I'm going to close this for now. But I'll add some experimenting with the different backends to my todo list to see if there's an easy way to make the jupyter support more robust.


Update CI to use Xcode 14

Same changes to simulators as in Kiwi - SE goes from 1st gen to 3rd gen.
Resolves #320.

I am thinking whether it would be better to not include the iOS version in the folder name and have simply folders like iPad, iPhone SE, iPhone 13. Because with each iOS change the diff will contain only all deleted and all new files.

Ok, so updated so that only two folders of snapshots exist:

iPhone
iPad

Triggered regeneration job...


Add support for Raspberry Pi 4

https://www.raspberrypi.org/products/raspberry-pi-4-model-b/

[zrzka] This issue has attached support thread https://jel.ly.fish/#/support-thread~a2429e1b-cd1a-44c1-97e1-2bac67f240ec

[zrzka] This issue has attached support thread https://jel.ly.fish/#/support-thread~934864cc-2760-4b81-955c-1a62e1ce62c7

[zrzka] This issue has attached support thread https://jel.ly.fish/#/support-thread~29bbffa5-1ee3-4243-944f-319018eb3f5f

[mikesimos] This issue has attached support thread https://jel.ly.fish/#/support-thread~e93453f9-5a3a-435e-8721-096442f6fcf8

[shaunmulligan] This issue has attached support thread https://jel.ly.fish/#/support-thread~b8b6d87d-d573-455a-a092-fe1e417876e0

[shaunmulligan] This issue has attached support thread https://jel.ly.fish/#/support-thread~d4041c72-dd3b-42b0-8525-4cf57170421d

Hi, are there any ETAs or updates regarding support for the RPi4?

Hi. No ETA yet. It can be in the following week, we need this https://github.com/agherzan/meta-raspberrypi/pull/437 merged first

@floion I can see that the https://github.com/agherzan/meta-raspberrypi/pull/437 ! I would be happy to test it out before the production release

@Jaeyoung-Lim There is some more work needed. We will update this thread when it's ready for a spin.

@agherzan Awesome

According to the status of https://github.com/agherzan/meta-raspberrypi/pull/437 it has now been merged. I there anything else required before balena OS can support running on an rpi4?

Hi, yes, there is an issue related to the production image not booting when console=null is supplied in the kernel cmdline. We are currently looking at this

Hi, yes, there is an issue related to the production image not booting when console=null is supplied in the kernel cmdline. We are currently looking at this

@floion thank you for the update

Hi! Any updates in the last week? Any hint of an ETA?
(Sorry to be nagging, our project will get a big benefit from being able to upgrade to the Pi 4!)

[zrzka] This issue has attached support thread https://jel.ly.fish/#/support-thread~1058708a-6881-4a4c-b44d-9c8a567ae930

No updates yet. This is still in the working queue

[zrzka] This issue has attached support thread https://jel.ly.fish/#/support-thread~c7e01c1e-0b8e-4682-9884-21bd4a0f28d9

Looking forward to this! Thanks for your hard work Balena team!

If you feel like testing some early support you can build https://github.com/balena-os/balena-raspberrypi/tree/ag/rpi4 (be aware that it's a wip branch which might get rebased).

@agherzan that branch hasn't been updated in 17 days. What's blocking the RPI4 branch being merged? Are there changes up-stream you're still waiting on?

Ok, @agherzan do you have any indication of timeline? If we're talking 1-2 weeks then we'll wait. Anything more I'll build that branch and we'll use that for a project we need to deploy. Thanks

@agherzan I share the same status with @ollym

@agherzan I'm also in the same status as @ollym  and @Jaeyoung-Lim

Hi. Good to see this interest. We are currently testing and finalising support. The optimist estimation for deploying is this week if testing reveals no major issues.

Hi @agherzan. Any news regarding the merge to master branch?

The support PR is up and in review.

Do you expect it to be merged today?

It might happen. The best way to confirm this is to follow the PR.

Well. My timing could not have been more perfect, it seems.

Why isn't it merged? Is something still missing?

After merging can we expect it show up as a device option under the "Add a new device" section of the dashboard? Or will we still have to manually build?

Hi. Expect this to be available in the dashboard by Wednesday. I will try for Tuesday, depends on my workload

In the meantime does anybody have a raspberrypi4 image they can share? I'm running OSX and having trouble getting Yocto/oe to build. Ideally, an image that I can add a wpa_supplicant file to.

Any news @floion ?

Hi all, balenaOS version 2.41.0+rev4 is now available for RaspberryPi 4. Enjoy!

This is great - thank you! Looking forward to trying it out.
Out of curiosity, are there any plans to support 32 bit as well like with Pi 3?

@wlisac : you might want to take a look at the response to my question on the Balena forum:
https://forums.balena.io/t/building-balenaos-for-rpi4/23993

Works great!

Some help please. I get my pi4 only to boot loop when i test this out. I dont finding any information to solving it..

Hi, what exactly are you trying?