Add license

I was thinking in using your mobile app as the basis for a series of articles on mobile app security, but for doing so I need to know the license of it, which isn't actually present in the repo.
Can you please add a license to your repo.
Thanks.

Licence addded.


Could not decrypt pak files

Its not updated guys, if you want to have the newest version of the file editor then donate to his patreon and download it there if u dont want to wait

I have latest version of the Tool and I'm Still getting this error. Idk what to do tbh.


improve ZafiraClient->registerTestRun methods

move to deprecated state:
registerTestRunByHUMAN
registerTestRunBySCHEDULER
registerTestRunUPSTREAM_JOB

create new fresh
registerTestRun

new method should just get common parameters, maybe we can declare several the same methods with different dataset.

later when we test new implementation successfully we can remove deprecated methods and update DB (several fields can be removed completely)

Already impletented here: https://github.com/qaprosoft/zafira-client/pull/7


PCB misses traces KiCad 7.0

Hi,
First of all, thank you for making this! I'm a beginner in FPGA implementation and this design really helps me
I tried opening it in Kicad 7.0, and I'm having a problem: I can't see the traces on the board and the nets seem not to be linked. See attached picture.

Could you please help me on this ?
Thank you again for your work,
Alex

Hi,
seems you have some configuration to hide routes and vias... Is this happening in all layers? in the PCBnew window, on the right side you can configure what you see. Also, if you press 'B' all the zones will be reloaded. If the gaps for the traces are still in the zones, than the traces exists, but they are hidden.
Thanks!

Hi, thanks for helping me. The issue was trivial and I was too embarrassed to close it ...
I've now changed most of the things on the board although I'm still using your design for power supplies. Could you please clarify on which terms your work could be used ?
Also, is there a specific reason for using a regular 30mhz quartz instead of a 100mhz VCXO oscillator found on other boards ?
Thanks!
Alex


Fill solid optimizations per-color

NOTE: this is an improvement on #145 using "specialization" workaround. This PR does not need any Model changes.
This adds optimized (per color type) fill_solid paths as part of improving on issue https://github.com/almindor/mipidsi/issues/142.
This improved fill_solid fullscreen render speed on a ST7789 using 80Mhz SPI interface with esp32-c6 board running at 160Mhz CPU speed from ~48ms to ~18ms.
NOTE: the buffer size is arbitrarily chosen, bigger ones can get even better results, but I wanted to avoid using too much memory. If batch support is disabled these paths are not used. I hope we can come up with a better story for buffers overall in the future (e.g. wrt. to display-interface as well as this driver).

@rfuest I've implemented your suggestions, lmk if this looks good now. Do you know how soon is the next e-g going to be released? It might make sense to wait and simplify this before we go 0.9 but only if it's short term.

Do you know how soon is the next e-g going to be released? It might make sense to wait and simplify this before we go 0.9 but only if it's short term.

No, I don't know when I'll get around to finishing the new e-g version.

I just noticed that we'll have the same problem with this as we have with set_pixels_from_buffer:
https://github.com/almindor/mipidsi/blob/33a53887daef820395b1cd292eedb2d7621c0bcb/mipidsi/src/lib.rs#L276-L279
I don't have a good solution for this, except for documenting it. Our new internal endianness setting makes the entire display-interface problems even more confusing.

Yes, the DI needs reworking. It's hard to figure out what to do with it though, it seems between e-g, drivers (e.g. mipidsi) and the DI there's a bit of a leaky placement problem of things such as endianness (both storage format and expectations of the display), buffer use and blit optimizations.
Most of the issues seem to boil down to "losing information due to abstractions" in the end (e.g. DI not knowing about continuous pixels but being the place where buffers should probably be kept and used).
Right now though the DI is more of a problem than a helper, it even implicitly does a 64 pixel wide buffer (so not even bytes but depends on format) no matter what if anything but DataFormat::U8 is used.
One odd finding I had was that dynamic dispatch does not seem to impact performance much, I tried @GrantM11235's static dispatch approach with these changes and it actually made the performance worse.
But this all is a bigger discussion, I just don't know what the best place for it would be.

@rfuest should be good to go

Closing in favour of #149


Fedoraware Injection Error

Description:
I seem to be unable to Inject Fedoraware twice if i dont restart my PC after i injection, i get an error,as show below

Steps to reproduce the behavior:

Inject Fedoraware
2.Play some time
3.Close TF2
4.Try to Inject Fedoraware again
Fail
Get the error

that's an issue with fedoraloader, not fedoraware

You are using an outdated version of the loader.


[google_sign_in] Google Sign In dialog stuck loading when Fitness API scope requested

I can request only these two scopes:
'email',
'https://www.googleapis.com/auth/contacts.readonly',
If I'm adding something else, for example: https://www.googleapis.com/auth/fitness, and trying to sign in, after choosing account from list, displays an infinite loader.

Hi @AntonFesun
You're missing scope permissions on your Google console, please follow https://developers.google.com/fit/rest/v1/get-started
and you need proper scopes as well, check out https://developers.google.com/identity/protocols/oauth2/scopes and copy the scopes from there
GoogleSignIn _googleSignIn = GoogleSignIn(
  // Optional clientId
  // clientId: '479882132969-9i9aqik3jfjd7qhci1nqf0bm2g71rm1u.apps.googleusercontent.com',
  scopes: <String>[
    'email',
    'https://www.googleapis.com/auth/contacts.readonly',
    'https://www.googleapis.com/auth/fitness.activity.read',
  ],
);

and after making these changes, I can load the app and sign in

code sample
// Copyright 2013 The Flutter Authors. All rights reserved.
// Use of this source code is governed by a BSD-style license that can be
// found in the LICENSE file.

// ignore_for_file: public_member_api_docs

import 'dart:async';
import 'dart:convert' show json;

import "package:http/http.dart" as http;
import 'package:flutter/material.dart';
import 'package:google_sign_in/google_sign_in.dart';

GoogleSignIn _googleSignIn = GoogleSignIn(
  // Optional clientId
  // clientId: '479882132969-9i9aqik3jfjd7qhci1nqf0bm2g71rm1u.apps.googleusercontent.com',
  scopes: <String>[
    'email',
    'https://www.googleapis.com/auth/contacts.readonly',
    'https://www.googleapis.com/auth/fitness.activity.read',
  ],
);

void main() {
  runApp(
    MaterialApp(
      title: 'Google Sign In',
      home: SignInDemo(),
    ),
  );
}

class SignInDemo extends StatefulWidget {
  @override
  State createState() => SignInDemoState();
}

class SignInDemoState extends State<SignInDemo> {
  GoogleSignInAccount? _currentUser;
  String _contactText = '';

  @override
  void initState() {
    super.initState();
    _googleSignIn.onCurrentUserChanged.listen((GoogleSignInAccount? account) {
      setState(() {
        _currentUser = account;
      });
      if (_currentUser != null) {
        _handleGetContact(_currentUser!);
      }
    });
    _googleSignIn.signInSilently();
  }

  Future<void> _handleGetContact(GoogleSignInAccount user) async {
    setState(() {
      _contactText = "Loading contact info...";
    });
    final http.Response response = await http.get(
      Uri.parse('https://people.googleapis.com/v1/people/me/connections'
          '?requestMask.includeField=person.names'),
      headers: await user.authHeaders,
    );
    if (response.statusCode != 200) {
      setState(() {
        _contactText = "People API gave a ${response.statusCode} "
            "response. Check logs for details.";
      });
      print('People API ${response.statusCode} response: ${response.body}');
      return;
    }
    final Map<String, dynamic> data = json.decode(response.body);
    final String? namedContact = _pickFirstNamedContact(data);
    setState(() {
      if (namedContact != null) {
        _contactText = "I see you know $namedContact!";
      } else {
        _contactText = "No contacts to display.";
      }
    });
  }

  String? _pickFirstNamedContact(Map<String, dynamic> data) {
    final List<dynamic>? connections = data['connections'];
    final Map<String, dynamic>? contact = connections?.firstWhere(
      (dynamic contact) => contact['names'] != null,
      orElse: () => null,
    );
    if (contact != null) {
      final Map<String, dynamic>? name = contact['names'].firstWhere(
        (dynamic name) => name['displayName'] != null,
        orElse: () => null,
      );
      if (name != null) {
        return name['displayName'];
      }
    }
    return null;
  }

  Future<void> _handleSignIn() async {
    try {
      await _googleSignIn.signIn();
    } catch (error) {
      print(error);
    }
  }

  Future<void> _handleSignOut() => _googleSignIn.disconnect();

  Widget _buildBody() {
    GoogleSignInAccount? user = _currentUser;
    if (user != null) {
      return Column(
        mainAxisAlignment: MainAxisAlignment.spaceAround,
        children: <Widget>[
          ListTile(
            leading: GoogleUserCircleAvatar(
              identity: user,
            ),
            title: Text(user.displayName ?? ''),
            subtitle: Text(user.email),
          ),
          const Text("Signed in successfully."),
          Text(_contactText),
          ElevatedButton(
            child: const Text('SIGN OUT'),
            onPressed: _handleSignOut,
          ),
          ElevatedButton(
            child: const Text('REFRESH'),
            onPressed: () => _handleGetContact(user),
          ),
        ],
      );
    } else {
      return Column(
        mainAxisAlignment: MainAxisAlignment.spaceAround,
        children: <Widget>[
          const Text("You are not currently signed in."),
          ElevatedButton(
            child: const Text('SIGN IN'),
            onPressed: _handleSignIn,
          ),
        ],
      );
    }
  }

  @override
  Widget build(BuildContext context) {
    return Scaffold(
        appBar: AppBar(
          title: const Text('Google Sign In'),
        ),
        body: ConstrainedBox(
          constraints: const BoxConstraints.expand(),
          child: _buildBody(),
        ));
  }
}

flutter doctor -v
[✓] Flutter (Channel stable, 2.0.5, on Microsoft Windows [Version 10.0.19042.928], locale en-US)
    • Flutter version 2.0.5 at C:\Users\Taha\Code\flutter_stable
    • Framework revision adc687823a (6 days ago), 2021-04-16 09:40:20 -0700
    • Engine revision b09f014e96
    • Dart version 2.12.3

[!] Android toolchain - develop for Android devices (Android SDK version 30.0.3)
    • Android SDK at C:\Users\Taha\Code\SDK
    • Platform android-30, build-tools 30.0.3
    • ANDROID_HOME = C:\Users\Taha\Code\SDK
    • Java binary at: C:\Users\Taha\Code\android-studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)
    ✗ Android license status unknown.
      Run `flutter doctor --android-licenses` to accept the SDK licenses.
      See https://flutter.dev/docs/get-started/install/windows#android-setup for more details.

[✓] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[✓] Visual Studio - develop for Windows (Visual Studio Community 2019 16.9.3)
    • Visual Studio at C:\Program Files (x86)\Microsoft Visual Studio\2019\Community
    • Visual Studio Community 2019 version 16.9.31129.286
    • Windows 10 SDK version 10.0.19041.0

[✓] Android Studio (version 4.1.0)
    • Android Studio at C:\Users\Taha\Code\android-studio
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b01)

[✓] IntelliJ IDEA Community Edition (version 2021.1)
    • IntelliJ at C:\Program Files\JetBrains\IntelliJ IDEA Community Edition 2020.3.3
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart

[✓] VS Code (version 1.55.2)
    • VS Code at C:\Users\Taha\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension version 3.21.0

[✓] Connected device (5 available)
    • SM M025F (mobile)                  • R9ZR205XX0A   • android-arm    • Android 10 (API 29)
    • Android SDK built for x86 (mobile) • emulator-5554 • android-x86    • Android 10 (API 29) (emulator)
    • Windows (desktop)                  • windows       • windows-x64    • Microsoft Windows [Version 10.0.19042.928]
    • Chrome (web)                       • chrome        • web-javascript • Google Chrome 90.0.4430.85
    • Edge (web)                         • edge          • web-javascript • Microsoft Edge 89.0.774.77

! Doctor found issues in 1 category.

Actually I've added needed scopes in Google console (https://console.cloud.google.com/apis/credentials/consent), and there is also I have a infinite loader, after choosing a google account

@AntonFesun
Add https://www.googleapis.com/auth/fitness.activity.read and SHA-1 key to your console, follow the steps,
I was getting infinite loader too but following the steps I can login  https://github.com/flutter/flutter/issues/80877#issuecomment-824675137

@TahaTesser it's also enabled, SHA-1 key added to console, checked it twice, but it still spinning infinite loader((

Ok, I've created a new project in google cloud, added there scopes, also added that scopes in my code.
Enabled Fitness API here -> https://console.cloud.google.com/apis/library
And plugin google_sign_in still has tha issue with infinite loader after choosing account((

Yeah, created a new project and remover a 'https://www.googleapis.com/auth/fitness', and it works, thanks a lot!


Question: Way to wait for data to arrive and not just subscription ready

waitOn waits for a subscription to be ready. But being ready means that the data has already been sent by the server not that it has already arrived in the client (http://docs.meteor.com/#publish_ready).
This means I'd have to deal with the case where the data has not yet arrived when rendering.
So, let's say I have a challenges field in my users collection.
BasicController = RouteController.extend({
  waitOn: function() {
    return [
      Meteor.subscribe('currGame'),
      Meteor.subscribe('onlineUsersData')
    ];
  }
});

Template.game_board.helpers({
  online_players: function() {
    if (Meteor.user().challenges) {
      return // perform query that depends on challenges field
    } else {
      return [];
    }
  },

  challengers: function() {
    if (Meteor.user().challenges) {
      return // perform query that depends on challenges field
    } else {
      return [];
    }
  }
});

I have to place the if statement on all my helpers because sometimes at that point Meteor.user() only has the id, email, and username.
Is there a way to wait on the arrival of the data?

Just Incase you’re using Iro-router,  you’ll need to write a pure JavaScript version of @scottburch ‘s solution, as meteor doesn’t compile es6 in iron-router


Add a label for Sketchup Viewer

This label will download the latest Sketchup Viewer app. I couldn't find a way to add 'appNewVersion' as the page that publishes the release notes for Sketchup Viewer hasn't been updated for some time (we're at version 21.1 but the release notes mention version 18);
https://help.sketchup.com/en/sketchup-viewer/sketchup-viewer-release-notes
The major and minor Sketchup Viewer version numbering does seem to be alligned with Sketchup Pro.
Current Sketchup Viewer version: 21.1.331
Current Sketchup Pro version: 21.1.2
However, extracting the most recent version number of Sketchup Pro seems complicated;
https://help.sketchup.com/en/release-notes (we have to extract the major version from this page)
https://help.sketchup.com/en/release-notes/sketchup-desktop-20210 (we have to extract the minor and patch from this page).
Installomator % ./assemble.sh -l myLabel sketchupviewer
2021-11-07 09:20:31 sketchupviewer ################## Start Installomator v. 0.7.0
2021-11-07 09:20:31 sketchupviewer ################## sketchupviewer
2021-11-07 09:20:32 sketchupviewer BLOCKING_PROCESS_ACTION=tell_user
2021-11-07 09:20:32 sketchupviewer NOTIFY=success
2021-11-07 09:20:32 sketchupviewer LOGO=/System/Applications/App Store.app/Contents/Resources/AppIcon.icns
2021-11-07 09:20:32 sketchupviewer no blocking processes defined, using SketchUpViewer as default
2021-11-07 09:20:32 sketchupviewer Changing directory to /Users/Admin/Downloads/Installomator/build
2021-11-07 09:20:33 sketchupviewer App(s) found:
2021-11-07 09:20:33 sketchupviewer could not find SketchUpViewer.app
2021-11-07 09:20:33 sketchupviewer appversion:
2021-11-07 09:20:33 sketchupviewer Latest version not specified.
2021-11-07 09:20:33 sketchupviewer Downloading https://flex1540-esd.flexnetoperations.com/flexnet/operations/AnonymousDownload?systemFileID=18379637&eccnNum=5D002&leEnc=TSU&ccats=&nlr=F to SketchUpViewer.dmg
2021-11-07 09:21:07 sketchupviewer DEBUG mode, not checking for blocking processes
2021-11-07 09:21:07 sketchupviewer Installing SketchUpViewer
2021-11-07 09:21:07 sketchupviewer Mounting /Users/Admin/Downloads/Installomator/build/SketchUpViewer.dmg
2021-11-07 09:21:19 sketchupviewer Mounted: /Volumes/SketchUp Viewer 2021 1
2021-11-07 09:21:19 sketchupviewer Verifying: /Volumes/SketchUp Viewer 2021 1/SketchUpViewer.app
2021-11-07 09:21:33 sketchupviewer Team ID matching: J8PVMCY7KL (expected: J8PVMCY7KL )
2021-11-07 09:21:33 sketchupviewer Downloaded version of SketchUpViewer is 21.1 (replacing version ).
2021-11-07 09:21:33 sketchupviewer DEBUG enabled, skipping remove, copy and chown steps
2021-11-07 09:21:33 sketchupviewer Finishing…
2021-11-07 09:21:44 sketchupviewer App(s) found:
2021-11-07 09:21:44 sketchupviewer could not find SketchUpViewer.app
2021-11-07 09:21:44 sketchupviewer Installed SketchUpViewer
2021-11-07 09:21:44 sketchupviewer notifying
2021-11-07 09:21:44 sketchupviewer Unmounting /Volumes/SketchUp Viewer 2021 1
"disk5" ejected.
2021-11-07 09:21:45 sketchupviewer DEBUG mode, not reopening anything
2021-11-07 09:21:45 sketchupviewer ################## End Installomator, exit code 0

Thank you for this contribution.
I can see you can isolate the version from the download link, that links to another place:
% curl -fs https://www.sketchup.com/sketchup/SketchUpViewer-en-dmg | grep "<a href=" | sed 's/.*href="//' | sed 's/".*//'
https://flex1540-esd.flexnetoperations.com/flexnet/operations/AnonymousDownload?systemFileID=18379637&eccnNum=5D002&leEnc=TSU&ccats=&nlr=F
% curl -fsIL "https://flex1540-esd.flexnetoperations.com/flexnet/operations/AnonymousDownload?systemFileID=18379637&eccnNum=5D002&leEnc=TSU&ccats=&nlr=F"
HTTP/1.1 302 Found
Date: Sun, 07 Nov 2021 17:55:30 GMT
Server: Apache
X-Frame-Options: SAMEORIGIN
Location: https://download.flexnetoperations.com/439214/1540/637/18379637/SketchUpViewer-2021-1.2.dmg?ftpRequestID=9158894037&server=download.flexnetoperations.com&dtm=DTM20211107175530MTg3NTQxNTg=&authparam=1636336530_7fd5a9f605e8b779e9356bd8e9503428&ext=.dmg
Set-Cookie: JSESSIONID=0000rQZxw1WYg1PoTAB4SxF172T:-1; Path=/; HttpOnly
Expires: Thu, 01 Dec 1994 16:00:00 GMT
Cache-Control: no-cache="set-cookie, set-cookie2"
Vary: User-Agent
Content-Type: text/html;charset=UTF-8
Content-Language: en-US
Set-Cookie: NSC_<IP_ADDRESS>_GOPXFC_443=14b5a3d94e3ccba681f7b2ff48ee03d4bb9c24581b8369761478e63378ce464c06e23611;path=/;secure;httponly
Strict-Transport-Security: max-age=4294967294

HTTP/1.1 200 OK
Accept-Ranges: bytes
Content-Length: 169086512
Content-Type: application/octet-stream
ETag: "36de2ea6fa67a247f868a6c01f21d704:1631287658.487088"
Last-Modified: Thu, 09 Sep 2021 19:55:44 GMT
Server: AkamaiNetStorage
Date: Sun, 07 Nov 2021 17:55:30 GMT
Connection: keep-alive

We have tutorials where those are separated, could you take a look at those?

I've been able to extract the version number from the 'Location' as you've advised;
appNewVersion=$(curl -fsIL "$downloadURL" | grep .dmg | sed 's/.SketchUpViewer-//' | sed 's/.dmg.//' )
However, this will extract: 2021-1.2. This doesn't match the bundle identifier of Sketchup Viewer.
The short bundle identifier of Sketchup Viewer is: 21.1
The Bundle identifier is: 21.1.331
I can offcourse try to to change 2021-1.2 into 21.1 but I'm not sure if this is the correct approach. What do you suggest?

I can see that these versions will never match up.


Catch errors from test framework

Exception during test initialization + some non-daemon thread created during this process prevents runner process from termination.

Thanks for reporting the issue. We are interested in when this happens. Could you make a minimal reproducible case?

Minimal test:
https://gist.github.com/darl/77008a469860fc02ba15e3d2a210b732
Another key requirement is "fatal exception":
in this case it is java.lang.ExceptionInInitializerError which extends java.lang.LinkageError

Thanks for the example. It looks good to me but I would like to have another maintainer @SrodriguezO
to take a look.


Non-deterministic rendering of Graph in 3D

Running this code:
class MovingVertices(ThreeDScene):
    def construct(self):
        self.set_camera_orientation(phi=75 * DEGREES, theta=30 * DEGREES)
        vertices = [1, 2, 3, 4]
        edges = [(1, 2), (2, 3), (3, 4), (1, 3), (1, 4)]
        g = Graph(vertices, edges)
        self.play(Create(g))
        self.wait()

On the latest version (this repo) results in non-deterministic rendering. You can see this by running the file several times with caching disabled.
Some of the different outputs include:
https://user-images.githubusercontent.com/9102529/115135963-28a9a880-a04f-11eb-95cf-a6affcff8717.mp4
https://user-images.githubusercontent.com/9102529/115135964-29dad580-a04f-11eb-8d3b-567be88952e9.mp4
https://user-images.githubusercontent.com/9102529/115135966-2ba49900-a04f-11eb-9d28-04fffa06ac10.mp4
I've also created a Colab notebook that installs manim directly from this repo, and the bug is replicable there, ruling out the possibility that it is only a problem with my system:
https://colab.research.google.com/drive/1DUHnR9e-Edbg8EVgKTBZna0I9MG1vqHn?usp=sharing
Expected behavior
The rendering should be deterministic, and probably give the output that is given in the stable version:
https://user-images.githubusercontent.com/9102529/115135993-5262cf80-a04f-11eb-8512-8a09abf76cc6.mp4
How to reproduce the issue

Code for reproducing the problem
Paste your code here.

Additional media files

Images/GIFs

Logs
Terminal output

PASTE HERE OR PROVIDE LINK TO https://pastebin.com/ OR SIMILAR

System specifications
System Details

OS (with version, e.g Windows 10 v2004 or macOS 10.15 (Catalina)):
RAM:
Python version (python/py/python3 --version):
Installed modules (provide output from pip list):

PASTE HERE

LaTeX details

LaTeX distribution (e.g. TeX Live 2020):
Installed LaTeX packages:

FFMPEG
Output of ffmpeg -version:
PASTE HERE

Additional comments

Apparently this is intentional. Closing.


ssh-ed25519

Bug description
Put here a clear and concise description of what the bug is
Screenshots
If applicable, add screenshots to help explain your problem
Steps to reproduce

Error is thrown

Hello @abirfo1  👋
Thanks for your issue!
But...
Please edit your issue description to better describe your encountering trouble.
Have a nice day ☀


sioyek: add version 1.1.0

Closes #8098

Persists user config and last opened file

Should we suggest vcredist & delete it from $dir? It is included in the portable zip and is 24MB.

[x] I have read the Contributing Guide.

/verify

Should we suggest vcredist & delete it from $dir?

I think we should do that.


⚠ Bofrost.at has degraded performance

In f0c81d3, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 1514 ms

Resolved: Bofrost.at performance has improved in 8363d6d after 22 minutes.


Automatically generate the intra doc links

Addresses #245
The doc links are changed from [comment](struct.StructName.html) to [comment](StructName).
I realized that the documentation for TweedieRegressor was not generating. To fix it and to match the public API of linfa-linear with the other crates (e.g. KMeans and KMeansParams from linfa_clustering), I made the following changes:

The documentation for TweedieRegressorValidParams (which is not public), is moved for TweedieRegressor
TweedieRegressorParams is now public

Small fixes:

FittedCountVectorizer -> CountVectorizer in linfa-preprocessing

I think TweedieRegressorValidParams should also be made public.
Also, do you mind setting #![deny(rustdoc::broken_intra_doc_links)] for the crates?

Codecov Report
Base: 55.63% // Head: 55.53% // Decreases project coverage by -0.09% :warning:

Coverage data is based on head (e7a7af4) compared to base (d34313c).
Patch has no changes to coverable lines.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #246      +/-   ##
==========================================
- Coverage   55.63%   55.53%   -0.10%
==========================================
  Files          96       96
  Lines        8948     8945       -3
==========================================
- Hits         4978     4968      -10
- Misses       3970     3977       +7

Impacted Files
Coverage Δ

...ms/linfa-clustering/src/appx_dbscan/hyperparams.rs
7.89% <ø> (ø)

...orithms/linfa-clustering/src/dbscan/hyperparams.rs
0.00% <ø> (ø)

...linfa-clustering/src/gaussian_mixture/algorithm.rs
55.88% <ø> (-0.74%)
:arrow_down:

...nfa-clustering/src/gaussian_mixture/hyperparams.rs
33.33% <ø> (ø)

...rithms/linfa-clustering/src/k_means/hyperparams.rs
44.06% <ø> (ø)

...orithms/linfa-clustering/src/optics/hyperparams.rs
26.47% <ø> (+8.82%)
:arrow_up:

algorithms/linfa-linear/src/glm/hyperparams.rs
12.96% <ø> (+1.85%)
:arrow_up:

algorithms/linfa-linear/src/glm/mod.rs
55.55% <ø> (-0.70%)
:arrow_down:

algorithms/linfa-logistic/src/lib.rs
69.55% <ø> (+0.35%)
:arrow_up:

algorithms/linfa-nn/src/balltree.rs
56.80% <ø> (+0.79%)
:arrow_up:

... and 47 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

Instead of adding  #![deny(rustdoc::broken_intra_doc_links)] for the crates, how about checking the broken links in the CI? I tested it with c00c9af, and the CI is failing now for that commit.
I also added the --workspace flag to cargo doc in the CI to build the documents of all the crates.
TweedieRegressorValidParams is public now, as you suggested.


Improve OOB API demonstration

removed non required parameters from mo command line:

--input shape if model with static shape
--data_type if no conversion to fp16
--framework - use autodetection

removing providing bin file for model reading (xml path should be enough)
Update outdated release specific messages

@adrianboguszewski can you review this?


allow deferred binding so src and name can be null or undefined

We are wrapping <svg-icon> with some dynamic sugar.  When we do so, based on our own component properties, we set either angular-svg-icon name or src properties.  When use our wrapper component with an *ngIf, we effectively have deferred binding, and in this case, angular-svg-icon code (from the init() method) is causing a few errors in the console ultimately from Angular's HttpXsrfInterceptor.    Because of Angular's life cycle, our icon eventually does render, but initially both name and src are not set, so it causes this error in the console that  req.url is undefined (src line referenced below is var lcUrl = req.url.toLowerCase();)
PR #78 addresses this issue.
TypeError: Cannot read property 'toLowerCase' of undefined
    at<EMAIL_ADDRESS>(vendor.js:27013)
    at<EMAIL_ADDRESS>(vendor.js:26427)
    at<EMAIL_ADDRESS>(vendor.js:27064)
    at MergeMapSubscriber.project (vendor.js:26247)
    at MergeMapSubscriber.push../node_modules/rxjs/_esm5/internal/operators/mergeMap.js.MergeMapSubscriber._tryNext (vendor.js:158227)
    at MergeMapSubscriber.push../node_modules/rxjs/_esm5/internal/operators/mergeMap.js.MergeMapSubscriber._next (vendor.js:158217)
    at MergeMapSubscriber.push../node_modules/rxjs/_esm5/internal/Subscriber.js.Subscriber.next (vendor.js:152674)
    at Observable._subscribe (vendor.js:154853)
    at Observable.push../node_modules/rxjs/_esm5/internal/Observable.js.Observable._trySubscribe (vendor.js:152055)
    at Observable.push../node_modules/rxjs/_esm5/internal/Observable.js.Observable.subscribe (vendor.js:152041)

@czeckd , reaction?
thanks.

@btmurrell Plan to get your pull request merged into the next release.

Great.  Thanks!

@btmurrell Your change should now be in<EMAIL_ADDRESS>Thanks!


What is the command for integration tests of userns check?

8 checks(docker/dco-signed,documentation,experimental,gccgo,janky,userns,win2lin,windowsTP4) would be executed when a pull request is created.
I can execute integration tests of janky check in the following command.
docker run -d --privileged -v pwd:/go/src/github.com/docker/docker rnd-dockerhub.huawei.com/library/dockercore-docker:latest bash -c "cd /go/src/github.com/docker/docker && ./hack/make.sh binary test-integration-cli"
What is the command for integration tests of userns check?

If you are reporting a new issue, make sure that we do not have any duplicates already open. You can ensure this by searching the issue list for this repository. If there is a duplicate, please close your issue and add a comment to the existing issue instead.
If you suspect your issue is a bug, please edit your issue description to include the BUG REPORT INFORMATION shown below. If you fail to provide this information within 7 days, we cannot debug your issue and will close it. We will, however, reopen it if you later provide the information.
For more information about reporting issues, see CONTRIBUTING.md.
You don't have to include this information if this is a feature request
(This is an automated, informational response)

BUG REPORT INFORMATION
Use the commands below to provide key information from your environment:
docker version:
docker info:
Provide additional environment details (AWS, VirtualBox, physical, etc.):
List the steps to reproduce the issue:
1.
2.
3.
Describe the results you received:
Describe the results you expected:
Provide additional info you think is important:
----------END REPORT ---------
#ENEEDMOREINFO

Set DOCKER_REMAP_ROOT  environment to enable the userns integration test

Many thanks.


Primitive conversions

Specification
Sometimes the ID is used as a string when used in POJO objects or ES6 maps. In these cases, an ArrayBuffer is not easily turned into a string.
What we can do is to make use of ideas from https://javascript.info/object-toprimitive. This will enable us the ability to convert it to primitives.
There are 2 main primitives strings or numbers. I don't believe there is a proper numeric representation of Ids. This is because the Ids are 128 bits, and won't fit into a JS number. And even BigInt is only 64 bits. It would only be possible by truncating the 128 bits into a number. This could be done by using new Float64Array(2) and putting all 128 bits into that. But again it wouldn't really mean much. Except perhaps by understanding the first 64 bits as a floating point number (of which the last bit may make the numbers negative).
So for now, we can instead represent numbers as NaN. And this is the case with ArrayBuffer like +ab is NaN.
More useful is the string representation. The 2 hints that lead to string primitive is the string hint and the default hint and also the toString() call.
// output
alert(obj);

// using object as a property key
anotherObj[obj] = 123;

If the binary string version of the 128 bit identifier can be sorted in the same way that Buffer.compare does it, then this could be done.
It would be ideal that we could do id1 > id2 too, but this uses the number hint.
So basically we can try:

string and default to binary string
ensure that binary string comparison is the same as Buffer.compare
deal with the lack of appropriate number comparison and maybe id1 > id2 could be achieved
extending class Id extends ArrayBuffer could be used, but some of these operations will require direct access, which means Uint8Array would be preferred
alternatively if we would expect that end-users may use feross/buffer as a devDependency when bundling, then it's also possible to use import { Buffer } from 'buffer'; and this can simplify our comparisons and integration into the rest of PK

Additional context

https://javascript.info/object-toprimitive
https://gitlab.com/MatrixAI/Engineering/Polykey/js-polykey/-/merge_requests/205#note_702195122 - discussion leading to this change
Note that Buffer is Uint8Array and Uint8Array is ArrayBuffer, so Buffer is the most flexible. However there is the issue of detached array buffers. Node buffers aren't able to be detached: https://github.com/MatrixAI/js-polykey/issues/220
#2 - if we use Buffer, that impacts the goal to make ES compliant, but those are separate concerns...

Tasks

[ ] - Experiment with Symbol.toPrimitive, toString and valueOf
[ ] - Experiment with extending ArrayBuffer, or Uint8Array or Buffer if it makes it easier...
[ ] - Update tests for new types
[ ] - Add new tests for primitive usage like using in POJOs, Maps and comparisons.

class Left {
  public [Symbol.toPrimitive](hint: 'string' | 'number' | 'default') {
    return 'a';
  }
}

class Right {
  public [Symbol.toPrimitive](hint: 'string' | 'number' | 'default') {
    return 'b';
  }
}

const left = new Left;
const right = new Right;

console.log(left < right);
console.log(left <= right);
console.log(left > right);
console.log(left >= right);

The above shows that hint will be number on these comparisons, but toPrimitive can return a string instead. The hint is just a hint. You don't have to abide by it. Then the result is that they are "cast" to 'a' < 'b'. Which in the case of string comparison is correct.

If compareFunction is not supplied, all non-undefined array elements are sorted by converting them to strings and comparing strings in UTF-16 code units order. For example, "banana" comes before "cherry".

Note: In UTF-16, Unicode characters above \uFFFF are encoded as two surrogate code units, of the range \uD800-\uDFFF. The value of each code unit is taken separately into account for the comparison. Thus the character formed by the surrogate pair \uD655\uDE55 will be sorted before the character \uFF3A.

So it's the value of each "code unit". Each code unit in UTF 16 may be 2 bytes. If we convert our strings as binary strings.
However when using Buffer.from(...).toString('binary') this is an alias for the latin1 encoding. The node docs say:

'latin1': Latin-1 stands for ISO-8859-1. This character encoding only supports the Unicode characters from U+0000 to U+00FF. Each character is encoded using a single byte. Characters that do not fit into that range are truncated and will be mapped to characters in that range.

This is basically ASCII or more appropriately https://en.wikipedia.org/wiki/ISO/IEC_8859-1.
In terms of encoding the buffer, the buffer is already single bytes.
I'm not sure what it means to encode into latin1 string, and then comparing the string during a sort when it says it uses UTF16 code points.
Reading this: https://kevin.burke.dev/kevin/node-js-string-encoding/ means that JS strings are always encoded with UTF16. However the runtime appears to do alot of automatic conversions. So for most inputs into a JS program, it's expected that inputs will be in UTF-8. However internally I believe it is utf16. When you do Buffer.from(s, 'utf8') or Buffer.from(s, 'utf16le') they both work because JS knows that the string is utf16 encoded, and will translate it to utf8 or utf16le on the fly.
How does this impact us? Well when we return a binary string from of an ID. Whatever encoding we choose, we should check that the string length is ultimately 16 to mean 16 bytes, I think this will work because latin1 or binary encoding is 8 bit ascii, and that will cover the full range. I wonder though, if that means the the string will be translated to utf16 and stored as utf16.
During a sort, if it considers the string in utf16 codepoints, then my idea that it would compare on the individual byte numbers isn't how it works. The concern would be whether it would result in a codepoint that is out of order from the bit numbering scheme in the id.

Regarding operator overloading, TS has some problems:

https://github.com/microsoft/TypeScript/issues/4538
https://github.com/microsoft/TypeScript/issues/2361

This means we get type errors when we try to use then as indexes:
class Left {
  public [Symbol.toPrimitive](hint: 'string' | 'number' | 'default') {
    return 'a';
  }
}

const obj = {};

// @ts-ignore
obj[left] = 1;

Funnily enough the comparison operators work.
It seems the only way is with explicit typecasts like left as unknown as string.


Incomplete teiHeader extracted for paper

I understand that Grobid will not extract perfect metadata in every case, but I think this one is interesting nonetheless.
For 10.1016/S0140-6736(99)01239-8 neither the title nor the authors are present in the teiHeader section of the document when I run it through Grobid.
Title is blank and authors look like:
<biblStruct>
        <analytic>
                <author>
                        <affiliation key="aff0">
                                <orgName type="department">Department of Community Child Health</orgName>
                                <orgName type="institution" key="instit1">Royal Free Campus</orgName>
                                <orgName type="institution" key="instit2">Royal Free and University College Medical School</orgName>
                                <orgName type="institution" key="instit3">University College London</orgName>
                                <address>
                                        <postCode>NW3 2QG</postCode>
                                        <settlement>London</settlement>
                                        <country key="GB">UK</country>
                                </address>
                        </affiliation>
                </author>
                <author>
                        <affiliation key="aff1">
                                <orgName type="department">Department of Statistics</orgName>
                                <orgName type="laboratory">Immunisation Division, Public Health Laboratory Service Communicable Disease Surveillance Centre, London (E Miller FRCPath, P A Waight BSc);</orgName>
                                <orgName type="institution">Open University</orgName>
                        </affiliation>
                </author>
        </analytic>
        <monogr>
                <imprint>
                        <date/>
                </imprint>
        </monogr>
        <note>Summary</note>
</biblStruct>

But the document itself seems fairly clear to the human eye, so may be a good test case!

Hi @bananaoomarang ! Thanks this is an interesting case, to relate to #373 #136
The problems are all due to the PDF stream order. You can see the issue simply by trying to highlight the PDF in the PDF viewer of the web browser.
Using the reading order solves the problem, it is implemented but not activated by default because I need to retrain the header model, and for this to put first the training data of the Header model in the reading order rather the current PDF stream order...
Using the reading order - which can be done nows by un-commenting this line: https://github.com/kermitt2/grobid/blob/master/grobid-core/src/main/java/org/grobid/core/document/DocumentSource.java#L97 ), we then get:
...
                <biblStruct>
                    <analytic>
                        <author>
                            <persName
                                xmlns="http://www.tei-c.org/ns/1.0">
                                <forename type="first">Brent</forename>
                                <surname>Taylor</surname>
                            </persName>
                        </author>
                        <author>
                            <persName
                                xmlns="http://www.tei-c.org/ns/1.0">
                                <forename type="first">Elizabeth</forename>
                                <surname>Miller</surname>
                            </persName>
                        </author>
                        <author>
                            <persName
                                xmlns="http://www.tei-c.org/ns/1.0">
                                <forename type="first">Paddy</forename>
                                <surname>Farrington</surname>
                            </persName>
                        </author>
                        <author>
                            <persName
                                xmlns="http://www.tei-c.org/ns/1.0">
                                <forename type="first">Maria-Christina</forename>
                                <surname>Petropoulos</surname>
                            </persName>
                        </author>
                        <author>
                            <persName
                                xmlns="http://www.tei-c.org/ns/1.0">
                                <forename type="first">Isabelle</forename>
                                <surname>Favot-Mayaud</surname>
                            </persName>
                        </author>
                        <author>
                            <persName
                                xmlns="http://www.tei-c.org/ns/1.0">
                                <forename type="first">Jun</forename>
                                <surname>Li</surname>
                            </persName>
                        </author>
                        <author>
                            <persName
                                xmlns="http://www.tei-c.org/ns/1.0">
                                <forename type="first">Pauline</forename>
                                <forename type="middle">A</forename>
                                <surname>Waight</surname>
                            </persName>
                        </author>
                        <title level="a" type="main">Autism and measles, mumps, and rubella vaccine: no epidemiological evidence for a causal association</title>
                    </analytic>
                    <monogr>
                        <imprint>
                            <date/>
                        </imprint>
                    </monogr>
                    <note>ARTICLES</note>
                </biblStruct>
            </sourceDesc>
        </fileDesc>
...
        <profileDesc>
            <abstract>

Background We undertook an epidemiological study to investigate whether measles, mumps, and rubella (MMR) vaccine may be causally associated with autism.

            </abstract>
        </profileDesc>

which is much better, and consolidation of header will also work.
Putting the training data of the header model in reading order should then make the rest right (abstract and affiliations). So normally grobid is on track to fix all this range of reading order issues, and it's more a matter of development time to get it finalised.


Kellnr calculates wrong checksum [CRITICAL]

Since last week (there was no particular event), kellnr started calculating the wrong checksums for the crates pushed to it.
This results in cargo not being able to verify checksums.
failed to verify the checksum of `v12-data v1.17.1 (registry `kellnr`)

As an example crate:
sqlite> select * from crate_index where name="v12-data" AND vers="1.17.1";
id|name|vers|deps|cksum|features|yanked|links|v|crate_fk
35|v12-data|1.17.1|...|90392cdc01079ee500391dd0fd409059158b83b170567361d2e3552b76450f6c|{}|0||1|5

The checksum here is not the checksum that would occur from running sha256sum, when we did a UPDATE crate_index ... with the result of sha256, that particular crate started correctly working (with cargo).
We're happy to help with resolving this issue asap, as it's a criticial bug for us, but would need some guidance as to where this issue could be originating from.
We're running the latest kellnr 5.2.1, with rust 1.77.2 on the buildserver (Jenkins) that pushes to kellnr, and locally 1.75+

Hi @alexthe2! Thanks for reporting the issue. Does this happen only with one specific crate or under specific circumstances? I'll try to reproduce the issue.

It happens with two crates for us (from what I can see right now), called v12-data and v12-terra_converters, v12-terra_converters is depndent on data

Can you provide logs from Kellnr in the "trace" mode, when the issue occurs? I try to replicate the wrongly computed hash, but so far without any success.

should I set KELLNR_LOG__LEVEL or KELLNR_LOG__LEVEL_WEB_SERVER?

KELLNR_LOG__LEVEL should be enough.

it's not producing any logs 😢 , I verfied that the level is really set to trace (updated helm chart, and deleted pod to force restart)

Hi @secana, we are experiencing the same issue. I could provide one more data point.
Compare the sha256sum of a corrupted crate in the db and the actual value:
In db:

Actual:

And I am already running with KELLNR_REGISTRY__CACHE_SIZE=0

I am running Kellnr 5.2.2 with the released docker image.
Thanks!

If I delete the corrupted version from the web ui as admin user, restart the docker container, and then publish the same crate again, it could fix the problem.

Fun story for us, if you hand fix the cksum in SQLite, it might solve the
problem for the next version.
The reason I say might is it solved it for one crate but not for all of them
On Sat, May 11, 2024, 12:18 AM Chao Gu @.***> wrote:

If I delete the corrupted version from the web ui as admin user, restart
the docker container, and then publish the same crate again, it could fix
the problem.
—
Reply to this email directly, view it on GitHub
https://github.com/kellnr/kellnr/issues/311#issuecomment-2105336594, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AIBZJB247NNNPAJFMTXG2BTZBVBSNAVCNFSM6AAAAABHDRHCLWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBVGMZTMNJZGQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

Thanks for the input. So far, the issue seems to be the computation of the sha256, as the crate itself seems to be fine on disk. I released a debug version of kellnr with much more debug output for the specific issue. Would you be so kind and try to run it and provide the logs here?
Kellnr version: 5.2.3-debug-311
Helm chart version: 3.2.3-debug-311
All logs are in the level debug and prefixed with #311 to be easily identifiable. For the debug version, I added an additional crate to compute the sha256 and be able to compare it with the current implementation. Hopefully the debug output shows us the right direction to finally find and fix the issue.

Thanks @secana! I have deployed this test version with logs enabled. I tried to publish a test crate 10 times (with slight modification each time) and the logs looks good to me. My team will continue to use this version and I will show the logs here if the issue happens again.
Thanks for the help!

New version of Kellnr 5.3.2 is out with improved SHA256 computation. This error should be fixed with that version.

Also a finishing update from our side, we got the debug version running two days ago, no issues yet, we'll now switch to the new 5.3.2

Hi @secana, my team have the debug version running for almost 10 days and we captured this issue again. Here is the log:

It seems that the error is happenned when reading the crate saved to disk back into memory for sha256 calculation, it only reads 4096 bytes.
However it seems you have already switched to use the in-memory data to calcualte checksum so I think this is not going to happen again. We will switch to the new 5.3.2.
Thanks a log for the help!

Hi @secana, sorry to keep posting on a closed issue, but I did some study for the actual root cause.
I was able to reproduce the reading issue by this minimal reproducible example:
use std::path::Path;

use anyhow::Result;
use tokio::{
    fs::File,
    io::{AsyncReadExt, AsyncWriteExt},
};

#[tokio::main]
async fn main() -> Result<()> {
    let path = Path::new("test/source.crate");

    let mut file = File::open(path).await?;

    let mut source = Vec::new();
    let _ = file.read_to_end(&mut source).await?;

    let source_length = source.len();

    println!("source length: {}", source_length);

    let mut test = 1;

    loop {
        let path = Path::new("test/test.crate");

        let mut file = File::create(&path).await?;
        file.write_all(&source).await?;

        // if we comment this line, we could reproduce the read issue
        file.flush().await?;

        let mut buf: Vec<u8> = vec![];

        let mut file = File::open(&path).await?;
        let bytes_read = file.read_to_end(&mut buf).await?;
        let real_length = file.metadata().await?.len();

        if bytes_read != source_length || real_length != source_length as u64 {
            println!(
                "test {}, bytes read: {}, real length: {}",
                test, bytes_read, real_length
            );
            break;
        }

        test += 1;
    }

    Ok(())
}

As shown in the comment, it seems that we should flush the io buffer after the write_all() call, otherwise we will trigger this issue occasionally. There is an useful comment from the maintainer of Tokio: https://users.rust-lang.org/t/async-write-all-sometimes-silently-fails/68195/4.
Not sure if it is still valid for the new version but maybe a flush() call is helpful.

@asymmetry Thank you so much! With the in-memory computation I build around the issue but knowing what went wrong initially gives me piece of mind. I'll check if I use the same code somewhere else in kellnr and make sure that I flush the buffer.

@secana Hi, looking at the code for the package download I think it has the same issue. In cratesio_api.rs the function download() will basically do the following three actions in order:

Get file  path from the crates_storage file_path = crate_storage.crate_path;
Check if it exists, if not download it and store it in the crate_storage.add_bin_package, that will use write_all to write the crate to disk;
Read the contents from disk crate_storage.get_file.

For the initial download this means there are two IO actions. Write to disk, and than read back and store in cache. I Would suggest to just keep the data in memory here.

You guys mean it's fixed in version 5.2.3 i guess. Version 5.3.2 does not exist yet.

Yes, you are right. That' a typo. 5.2.3 is the right version.


Insomnia does not include part's content-type in curl command for multipart request

Expected Behavior
curl command to include ;type=application/json for metadata part
Actual Behavior
The ;type=application/json is missing and generated curl does not send a valid request.
The server responds:

Resolved [org.springframework.web.HttpMediaTypeNotSupportedException: Content type 'application/octet-stream' not supported]

Reproduction Steps

Consider the following simple http handler (since I am a Java developer, the example is based on Spring Boot), the App.groovy:

import groovy.transform.ToString
import org.springframework.web.multipart.MultipartFile;

@RestController
class WebApplication {
    @PostMapping(path = "/upload-file", consumes = "multipart/form-data")
    String home(@RequestPart MultipartFile file, @RequestPart FileUploadMetadata metadata) {
        println(metadata)
    }
}

@ToString
class FileUploadMetadata {
    String description
}

It expects multipart POST request of 2 parts:

the file itself
and some json-formatted metadata with description field (as an example)

run the server app with spring run App.groovy. PS the easiest way to get spring command is to install SDKMAN and then install both Java and Spring Boot: sdk i java, sdk i springboot
Create a POST multipart request with Insomnia for http://localhost:8080/upload-file, add some file and add metadata with the following content:

{
  "description": "Some description for my file"
}

Set JSON type for metadata part

Image

Execute the request with Insomnia, it works and the return code is 200
Copy and try to execute the curl command, the result will be:

curl --request POST \
  --url http://localhost:8080/upload-file \
  --header 'Content-Type: multipart/form-data; boundary=---011000010111000001101001' \
  --form 'metadata={
	"description": "Some description for my file"
}' \
  --form<EMAIL_ADDRESS>
and it does not work, because the ;type=application/json is missing for metadata
Is there an existing issue for this?

[X] I have searched the issue tracker for this problem.

Additional Information
No response
Insomnia Version
2021.7.2
What operating system are you using?
macOS
Operating System Version
Monterey 12.1
Installation method
brew install insomnia
Last Known Working Insomnia version
No response

Hi @gavvvr, thank you for reporting this issue!
I've been trying to follow your reproduction steps locally and I'm not able for now to make your example Groovy script work.
In any case it is indeed true, we don't seem to add the ;type=application/json, regardless, when exporting a request to curl.
This might point to a problem with the underlying library, httpsnippet,  we use for converting to curl, as when we send the request via Insomnia we seem to send the content type regardless:

We'll need to investigate a bit more, so we might not have any news for a while.
In the meantime feel free to report any other issue you come across 👍


model-full.py has array reshaping errors .

Hello .the Normal  Model compiles well but the model_full.py has error  on the lower part : because of the reshaping problem . Line 140
segnet_basic.add(Reshape((n_labels, img_h * img_w), input_shape=(12,img_h, img_w)))
They seem to be  fine mathematically too . The simplemodel definition(model-basic.py )  is similar like this yet it works .But teh Model-full.py has error in this part .
Any help diagnosing this would be great .

Perhaps update to the latest version, and make sure to set the model to use 'th' for theano, or just change the order to be used for TF


Cmake step failing for android build

When using cmake 3.6.3 with or without Ninja
CMake Error: CMAKE_C_COMPILER not set, after EnableLanguage
CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage
CMake Error: CMAKE_ASM_COMPILER not set, after EnableLanguage

When using 3.14.2 there additionally is with Ninja
CMake Error: CMake was unable to find a build program corresponding to "Ninja".

Without Ninja and android
CMake Error: CMake was unable to find a build program corresponding to "Unix Makefiles".

I'm on NDK 20, SDK API level 24. This is how I'm calling it:
cmake .. -DCMAKE_TOOLCHAIN_FILE=$ANDROID_NDK/build/cmake/android.cmake.toolchain -DANDROID_ABI=arm64-v8a -DANDROID_TOOLCHAIN=clang -DANDROID_ARM_NEON=1

I can compile QNNPACK for android without any problems by the way.

It should be:
-DCMAKE_TOOLCHAIN_FILE=$ANDROID_NDK/build/cmake/android.toolchain.cmake
not as in the README
-DCMAKE_TOOLCHAIN_FILE=$ANDROID_NDK/build/cmake/android.cmake.toolchain

Thank you for reporting this. Fixed in a344d23816542a1c91bc99c238fa520ac4936f9a


Fixed crash when changing a market order

Change messages for market orders don't have "new_size" and if the change message is for a market order, no action is needed.

Thank you for opening this up!  I've merged this, but it might actually be a larger issue since we aren't accounting for all of these possibilities.
Referencing GDAX API Doc's:
https://docs.gdax.com/?python#change

change messages are sent anytime an order changes in size; this includes resting orders (open) as well as received but not yet open. change messages are also sent when a new market order goes through self trade prevention and the funds for the market order have changed.

change messages for received but not yet open orders can be ignored when building a real-time order book. The side field of a change message and price can be used as indicators for whether the change message is relevant if building from a level 2 book.
Any change message where the price is null indicates that the change message is for a market order. Change messages for limit orders will always have a price specified.


"Bad State: No element & FormatException: Nothing to repeat" issues has been fixed.

Bad State: No element & FormatException: Nothing to repeat issues has been fixed.

Thank you very much for your contribution!, Merged :)


Add testTerminator parameter to function pointer assertion

Updated the function pointer assertion with the new(ish) testTerminator parameter.

Coverage remained the same at 99.907% when pulling e06bc357c4aaa0bdbab2724e4f348e9db97b3f98 on jerryryle:jryle/function-pointer-test-terminator into ea21a28e7bb206e9db30892aaa4d9edfd48968ee on cpputest:master.


Upgrade README.md on chromedriver

This is because I had the following issue:

brew update --cask chromedriver

Error: This command updates brew itself, and does not take formula names.
Use brew upgrade --cask chromedriver instead.

Review app deployed to https://teaching-vacancies-review-pr-3024.london.cloudapps.digital


cvat istallation eroor

i faced to an error while runing docker compose up _d i dont know what to do

Hi! It seems, you failed to connect to the official Docker registry during the installation process. This can happen for multiple reasons. For example, if you're behind a corporate proxy, you'll need to configure your proxy server settings.


[BUG] merlin models on vertex ai training - cuda error

Describe the bug
I've been able to train a Merlin model in a Vertex Notebook (using merlin base image). Now I'm trying to train the same model in Vertex AI Training. When training begins, I get this error:
numba.cuda.cudadrv.driver.LinkerError: [222] Call to cuLinkAddData results in UNKNOWN_CUDA_ERROR
ptxas application ptx input, line 9; fatal   : Unsupported .version 7.7; current version is '7.4'

Steps/Code to reproduce bug

I'm building this dockerfile, using the below as a base image:

FROM nvcr.io/nvidia/merlin/merlin-tensorflow:22.07

The error occurs in the model.fit() call in training_task.py

Expected behavior
Execute training
Environment details (please complete the following information):

Environment location: Google Cloud, Vertex AI Training Job
Driver:

Additional context

full training package

Actually I'm confused about the Driver Version. You see the results from nvidia-smi above.
However when I env | grep CUDA i get the following
env | grep CUDA
NVIDIA_REQUIRE_CUDA=cuda>=9.0
CUDA_CACHE_DISABLE=1
_CUDA_COMPAT_STATUS=CUDA Driver OK
CUDA_CUDA_LIBRARY=/usr/local/cuda/lib64/stubs
CUDA_VERSION=<IP_ADDRESS>
CUDA_PATH=/usr/local/cuda
CUDA_DRIVER_VERSION=515.48.08
_CUDA_COMPAT_PATH=/usr/local/cuda/compat
CUDA_HOME=/usr/local/cuda

Where driver version seems to be 515.48.08?

I'm not sure why this makes a difference, but here is what i've done to get around this error and start model training:
They use command and args differently.
This results in the error.
worker_pool_specs =  [
    {
        "machine_spec": {
            "machine_type": MACHINE_TYPE,
            "accelerator_type": ACCELERATOR_TYPE,
            "accelerator_count": ACCELERATOR_NUM,
        },
        "replica_count": 1,
        "container_spec": {
            "image_uri": IMAGE_URI,
            "command": ["python", "-m", "train_task"],
            "args": [
                f'--per_gpu_batch_size={PER_GPU_BATCH_SIZE}',
                f'--model_name={MODEL_NAME}',
                f'--train_dir={TRAIN_DATA}',
                f'--valid_dir={VALID_DATA}',
                f'--schema={SCHEMA_PATH}',
                f'--workflow_dir={WORKFLOW_DIR}',
                f'--max_iter={MAX_ITERATIONS}',
                f'--num_epochs={NUM_EPOCHS}',
                f'--gpus={gpus}',
            ],
        },
    }
]

This does not produce the error, and successfully begins training:
worker_pool_specs =  [
    {
        "machine_spec": {
            "machine_type": MACHINE_TYPE,
            "accelerator_type": ACCELERATOR_TYPE,
            "accelerator_count": ACCELERATOR_NUM,
        },
        "replica_count": 1,
        "container_spec": {
            "image_uri": IMAGE_URI,
            'command': ['sh','-euc',f'''
                    python -m train_task --per_gpu_batch_size={PER_GPU_BATCH_SIZE} \
                    --model_name={MODEL_NAME} --train_dir={TRAIN_DATA} \
                    --valid_dir={VALID_DATA} \
                    --schema={SCHEMA_PATH} \
                    --workflow_dir={WORKFLOW_DIR} \
                    --max_iter={MAX_ITERATIONS} --num_epochs={NUM_EPOCHS} --gpus={gpus}
                    '''
            ]
        }
    }
]

For reference, here is the complete image:

FROM nvcr.io/nvidia/merlin/merlin-tensorflow:22.07

WORKDIR /src

RUN pip install -U pip
RUN pip install google-cloud-bigquery gcsfs cloudml-hypertune
RUN pip install google-cloud-aiplatform kfp
RUN echo "deb [signed-by=/usr/share/keyrings/cloud.google.gpg] http://packages.cloud.google.com/apt cloud-sdk main" | tee -a /etc/apt/sources.list.d/google-cloud-sdk.list && curl https://packages.cloud.google.com/apt/doc/apt-key.gpg | apt-key --keyring /usr/share/keyrings/cloud.google.gpg  add - && apt-get update -y && apt-get install google-cloud-sdk -y

COPY training/* ./

ENV LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda/compat/lib.real:/usr/local/hugectr/lib:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:/usr/local/lib:/repos/dist/lib


Port changes to release branch

What type of PR is this?

Uncomment only one  /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:
/kind api-change
/kind bug
/kind cleanup
/kind design
/kind documentation
/kind failing-test
/kind feature
/kind flake

What this PR does / why we need it:
Port changes to the release branch, which should be used for the next ck8s-kubespray ck8s patch release.
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

What is the purpose for doing this for the v2.25 branch?
Also, https://github.com/elastisys/kubespray/pull/23/commits/15d1872a78375162cca34d3c1c0db000964b0203 doesn't work on top of v2.25

What is the purpose of doing this for the v2.25 branch?

To track the changes we have done on top of v2.25, which should (probably not this time) become a new patch release. As this should really be the process instead of creating a special branch that a customer uses. As we have noticed now that it was hard to track which branch we should use.

Also, 15d1872 doesn't work on top of v2.25

Okay, then i will drop that commit :+1: Sort of proves my point that is hard at the moment to know what should and should not be added to the next patch release :sweat_smile:


Tablet unload impacted by long-running compaction cancellation

Describe the bug
A tablet unload (i.e. due to migration request) may be delayed while a tablet is attempting to unload, but cannot due to pending compaction cancellations. We have observed that the tablet will wait for as long as 50+ minutes while compactions cancel.
Versions (OS, Maven, Java, and others, as appropriate):

Affected version(s) of this project: 2.1.2

To Reproduce
We are attempting to gather additional information to reproduce. Some preliminary information:

Tablets are being compacted by t-servers (i.e. not using external compactions).
Data being compacted is not expected to be filtered, however we are unsure if somehow the iterator may not be returning for an extended time.

Expected behavior
Migration request should complete within some shorter time.
Screenshots
N/A
Additional context
The manager logs:
2024-04-22T16:23:58,434 [balancer.HostRegexTableLoadBalancer] WARN: Not balancing tables due to 1 outstanding migrations

@dtspence - is it the case that you manually cancelled the compactions? If so, did your command complete, or did it hang too?

The FileCompactor checks if the compaction is still enabled for every key that it writes. I'm curious if the compaction was making progress (you said filtering was not expected which could also be a cause). Is this happening often? If not, is bouncing the tserver an option?

@dlmarion

is it the case that you manually cancelled the compactions? If so, did your command complete, or did it hang too?

No, the compaction eventually logs that it has canceled. We have not been taking manual intervention.

The FileCompactor checks if the compaction is still enabled for every key that it writes. I'm curious if the compaction was making progress (you said filtering was not expected which could also be a cause). Is this happening often? If not, is bouncing the tserver an option?

Yes, the issue is re-appearing. It does not appear to be localized to a single t-server. We have been wondering if something tablet related that correlates to the issue. At least one tablet we were looking at was a hot-spot and contained a lot of i-files from imports.

@dtspence  - are you seeing a lot of these messages?

@dlmarion

are you seeing a lot of these messages?

No we are not seeing the message above. Just for reference, it may have already been known - but we see:
2024-04-23T17:58:17,298 [tserver.UnloadTabletHandler] DEBUG: Failed to unload tablet <tablet-name> ... it was already closing or closed

I'm still thinking that maybe the compaction is not making progress. I don't think there is good logging for this with compactions that run in the Tablet Server. IIRC, the way to tell if it's making progress is to check out the output file for the compaction in HDFS and see if its size is increasing. If nothing is getting written to the file for a long time, then either it's filtering out a lot of data, or it's waiting on input from HDFS.

I would love to have something in place to avoid compaction from holding up unloading of tablets.  Is this something that is relative easy to do?  This would save us from long shutdowns as well.

Is this something that is relative easy to do?

It's not a switch that exists today. We would need to develop and test a solution. If you can identify which compactions are causing a tablet not to close, then you could run them as External Compactions. The existing codepath does not wait for the External Compactions to complete. It only waits for them if they are in the process of committing their changes to the tablet metadata.

We believe the compaction is not emitting a key/value to respond to the cancellation. We also observed that the issue appears to occur when a tablet splits (due to growth).
In all (or most) of the observed instances the following occurs:

T-server performs a sized-based split on a tablet into A and B.
T-server starts compaction for A.
Manager begins to migrate A and asks the t-server to close A.
T-server attempts to unload tablet and cancel the running compaction(s).
T-server eventually cancels compactions and tablet is unloaded.

If we introduced a delay in starting compactions for newly split tablets, then that might help mitigate this issue. We would have to make the delay time configurable most likely as timing the balancer can't really be done.

Delaying starting compactions after split could negatively impact scans. It may be hard to calibrate the delay to avoid scan and compaction cancel problems.
We could attempt to repeatedly interrupt the compaction thread.  Currently an atomic boolean is used instead of interrupting the thread because in the past some external code would eat interrupts.  The atomic boolean is only checked when a key values is returned.  I experimented with pushing the atomic boolean check lower in the iterator stack in the past and it had an impact on performance.
The code could do both approaches for cancellation, add new code to repeatedly interrupt the compaction thread and leave the existing code that sets the atomic boolean.

Delaying starting compactions after split could negatively impact scans. It may be hard to calibrate the delay to avoid scan and compaction cancel problems.

If we made it configurable at the table-level, then the user could make the decision as to whether or not to enable this, and how long the delay should be. We could also potentially ignore the timeout if the tablet is over the scan max files.

If we made it configurable at the table-level, then the user could make the decision as to whether or not to enable this, and how long the delay should be. We could also potentially ignore the timeout if the tablet is over the scan max files.

The code would need to emit enough information through logging to know if the property value needs adjustment.  The property could be dropped in elasticity as it would not longer be needed there.
The property only addresses one potential cause of stuck compactions causing problems.  There could be other cases where a stuck compaction is causing problems that was started by other means. This could be a user initiated compaction that is not returning data and preventing tablet unload or a tablet that did not recently split but is stuck in a system compaction that is preventing unload.


error when run python recognize.py models/output_graph.pb ae_recorded.wav models/alphabet.txt models/lm.binary models/trie

Loading model from file models/output_graph.pb
Traceback (most recent call last):
File "recognize.py", line 96, in
main()
File "recognize.py", line 63, in main
ds = Model(args.model, N_FEATURES, N_CONTEXT, args.alphabet, BEAM_WIDTH)
File "/home/robust_audio_ae/env/lib/python3.6/site-packages/deepspeech/init.py", line 40, in init
status, impl = deepspeech.impl.CreateModel(*args, **kwargs)
TypeError: CreateModel() takes at most 2 arguments (5 given)

Try
pip uninstall deepspeech
pip install deepspeech==0.1.0


branch-2.1 support array_split and array_reverse_split functions (#35619)

pick https://github.com/apache/doris/pull/35619

run buildall


Publish uplink over AMQP

And promoted types from mqtt to core/types

Coverage decreased (-0.5%) to 62.038% when pulling c05e437d630552e9944e0e34e6df4c3b587efd1e on feature/amqp into 3cc238b79761ec9d2b06a3847e6fbbcc63c34700 on v2-preview.

Coverage decreased (-0.5%) to 62.038% when pulling<PHONE_NUMBER>cd53760710d490de9977cbb7632de4 on feature/amqp into 3cc238b79761ec9d2b06a3847e6fbbcc63c34700 on v2-preview.

Coverage decreased (-0.5%) to 62.038% when pulling<PHONE_NUMBER>cd53760710d490de9977cbb7632de4 on feature/amqp into 3cc238b79761ec9d2b06a3847e6fbbcc63c34700 on v2-preview.


InAppPurchase.instance.purchaseStream.listen won't be triggered

Steps to reproduce
purchase a subscription with android using the code below.
The code suddenly stopped working several months ago.
_listenToPurchaseUpdated will never be called even through the purchase is shown as successful on google play.
Was there any changed around android subscription this year?
I've been stuck with this for months.
Expected results
_listenToPurchaseUpdated wil be called to proceed to the rest of the code.
Actual results
_listenToPurchaseUpdated never be called.
Code sample
Code sample
// init listener
_subscription = InAppPurchase.instance.purchaseStream.listen((list) {
      _listenToPurchaseUpdated(list);
    }, onDone: () {
      _subscription.cancel();
    }, onError: (error) {
      Ref.collec('purchase_log').doc('${SignIn.uid!}_eeeeee').set(
          {'data': Timestamp.now(), 'error': error}, SetOptions(merge: true));
    });

// listen
Future<void> _listenToPurchaseUpdated(
      List<PurchaseDetails> purchaseDetailsList) async {

    for (var purchaseDetails in purchaseDetailsList) {
      debugPrint("purchaseDetails $purchaseDetails");

      if (purchaseDetails.pendingCompletePurchase) {
        await InAppPurchase.instance.completePurchase(purchaseDetails);
      }

      if (Platform.isAndroid) {
        try {
          BillingClient client = BillingClient((_) {}, (_) {});
          await client.acknowledgePurchase(
              purchaseDetails.verificationData.serverVerificationData);
        } catch (e) {
          debugPrint('eeee $e');
        }
      }
    }
}

// purchase
await InAppPurchase.instance.buyNonConsumable(purchaseParam: purchaseParam);

Screenshots or Video

Screenshots / Video demonstration
[Upload media here]

Logs
Logs
[Paste your logs here]

Flutter Doctor output
Doctor output
% flutter doctor -v
[✓] Flutter (Channel stable, 3.22.2, on macOS 14.1.1 23B81 darwin-arm64, locale ja-JP)
    • Flutter version 3.22.2 on channel stable at /Users/tenna/developer/flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 761747bfc5 (7 weeks ago), 2024-06-05 22:15:13 +0200
    • Engine revision edd8546116
    • Dart version 3.4.3
    • DevTools version 2.34.3

[✓] Android toolchain - develop for Android devices (Android SDK version 33.0.0)
    • Android SDK at /Users/tenna/Library/Android/sdk
    • Platform android-35, build-tools 33.0.0
    • Java binary at: /Applications/Android Studio.app/Contents/jre/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 15.4)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Build 15F31d
    • CocoaPods version 1.15.2

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 2021.2)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
      🔨 https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.12+0-b1504.28-7817840)

[✓] VS Code (version 1.91.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.92.0

[✓] Connected device (9 available)
    • SCG08 (mobile)                  • RFCR71VND0N                              • android-arm64  • Android 13 (API 33)
    • Tenna’s iPhone11 (mobile)       • 00008030-0012304A01D3402E                • ios            • iOS 17.5.1 21F90
    • Tenna’s iPad (2) (mobile)       • 00008101-0015198A28782C3A                • ios            • iOS 17.5.1 21F90
    • Tenna’s iPad (mobile)           • d1802c9bcfe7b9b836383ca90361f9c15180f21e • ios            • iOS 17.5.1 21F90
    • Sota’s iPad (mobile)            • 00008030-0011253134E0C02E                • ios            • iOS 17.5.1 21F90
    • tenna’s iphone15 (mobile)       • 00008120-00120DDA1E10A01E                • ios            • iOS 17.5.1 21F90
    • macOS (desktop)                 • macos                                    • darwin-arm64   • macOS 14.1.1 23B81 darwin-arm64
    • Mac Designed for iPad (desktop) • mac-designed-for-ipad                    • darwin         • macOS 14.1.1 23B81 darwin-arm64
    • Chrome (web)                    • chrome                                   • web-javascript • Google Chrome 126.0.6478.183

[✓] Network resources
    • All expected network resources are available.

• No issues found!

InAppPurchase.instance.purchaseStream.listen was in fact working fine. The problem was the rest of my code inside of for (var purchaseDetails in purchaseDetailsList) {}.
Sorry for the buzz.


Strange error that keeps me to connect to a test dedicated server in localhost

For context, i was investigating a strange error that first appeared to me in singleplayer, everytime i try to create a new world that spawns me in either desert or badland biomes the internal server seems to just "die", leaving only a tiny fraction of the world generated and all entities paralized.
Before trying to mess with my modpack, i decided to boot up a test dedicated server in my computer with the same world type (large biomes) and seed to see if further errors would appear or if i would be able to play normally. But when i tried to connect to the test server it insta kicked me and this error appeared in the console, but no crash occurred. Don't know yet if this is related with the original problem i'm getting, but since it mentions azurelib i decided to report anyway to let you aware.
I'm using MC 1.21, fabric-loader-0.15.11-1.21, fabric-api-0.100.3+1.21 and azurelib-fabric-1.21-2.3.2.

Thanks for the report! This was actually found to affect 1.20.6 as well, so a patch for both it and 1.21 has been pushed now!


chore: release 1.2.219

:robot: I have created a release *beep* *boop*
1.2.219 (2023-03-29)
Bug Fixes

'certificate signed by unknown authority' and not working skip-tls-verify-registry param (b646359)
multiarch: do not override image metadata for secondary platforms (b49060e)
multiarch: do not override image metadata for secondary platforms (part 2) (838baef)
restart release-please process (63f4072)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/werf/werf/releases/tag/v1.2.219 :sunflower:


Multiple filters for Griddle v1

Is there a working example showing how to implement multiple filters for Griddle v.1, as was shown in the v. 0.x docs https://griddlegriddle.github.io/v0-docs/customization.html ?

This is also of great interest to me, I've been trying to figure out how to add multiple filters from a plugin I've made, but I don't see any obvious ways of doing so. It appears that the core functionality only allows one filter at a time.

I think this is a must have and looking forward to see how to plug-in into my griddle table. Anyone with some working example?

I've added by the way a modification in my forked repo in a way I can provide to a custom <Filter /> component an object to the setFilter action hook, being then responsibility of the plugins.Local's dataFilteredSelector to consider whether the filter is a plain string or an object.
Please any suggestion, enhancement or doubt, let's discuss it.
Therefore my custom Filter component:
class CustomFilter extends Component {
  constructor(props) {
    /* ... */

    this.state = {
      filter1: '',
      filter2: ''
    };
  }

  setFilter1(e) {
    this.setState({
      filter1: e.target.value
    }, () => {
      this.props.setFilter({
        filter1: this.state.filter1
      });
    });
  }

  setFilter2(e) {
    this.setState({
      filter2: e.target.value
    }, () => {
      this.props.setFilter({
        filter2: this.state.filter2
      });
    });
  }

  render() {
    return (
      <div className="custom__filters">
        <input
          type="text"
          name="filter"
          placeholder="Filter 1"
          value={this.state.filter1}
          onChange={this.setFilter1}
          style={this.props.style}
          className={cx(this.props.className, 'custom-filters__filter')} />
        <input
          type="text"
          name="filter"
          placeholder="Filter 2"
          value={this.state.filter2}
          onChange={this.setFilter2}
          style={this.props.style}
          className={cx(this.props.className, 'custom-filters__filter')} />
      </div>
    );
  }
}

CustomFilter.propTypes = {
  /* ... */
};

export default CustomFilter;

The dataFilteredSelector will consider we have two columns on our dataset identified by the keys: filter1 and filter2, filtering the data as follows:
export const filteredDataSelector = createSelector(
  dataSelector,
  filterSelector,
  (data, filter) => {
    return data.filter(row  => {
      return Object.keys(row.toJSON())
        .some(key => {
          if (typeof filter === 'string') {
            return row.get(key) && row.get(key).toString().toLowerCase().indexOf(filter.toLowerCase()) > -1
          }

          return row.get(key) && typeof filter[key] === 'string' && row.get(key).toString().toLowerCase().indexOf(filter[key].toLowerCase()) > -1;
        })
      })
  }
);

Thanks so much for this! I'll give it a try and report back.

Any update on being able to filter by column? I'm catching the events ..onFilter but i'm not sure what to do with it when i get it. I passed it the value onChange with this.props.events.onFilter(e.target.value). Any ideas?


Wrong axis labels on reliability diagrams for non-mean functionals

The xlabel and ylabel values are currently hardcoded:

https://github.com/lorentzenchr/model-diagnostics/blob/78ace74e267052029e4ef37526dd2c0b20b20800/src/model_diagnostics/calibration/plots.py#L208-L214

In particular they are wrong whenever functional != "mean".

I saw that when reading the following plot of the quantile regression example:

https://lorentzenchr.github.io/model-diagnostics/examples/quantile_regression/

@lorentzenchr I can take this up, I would use the variables functional and level when applicable to define the labels.
https://github.com/lorentzenchr/model-diagnostics/blob/78ace74e267052029e4ef37526dd2c0b20b20800/src/model_diagnostics/calibration/plots.py#L56-L67

"mean": E(Y|X)
"median": $q_{0.5}$(Y|X)
"expectile": $e_{level}$(Y|X)
"quantile": $q_{level}$(Y|X)

So for example for the expectile with level=0.8, the label on x axis would be
"prediction for  $e_{0.8}$(Y|X)"
and the label on the y axis:
"estimated $e_{0.8}$(Y|X)"


set borderRadius topLeft and bottomLeft affects the view displaying

<View style={{marginTop: 100,width: Width, height: 35, borderTopLeftRadius: 18, borderBottomLeftRadius: 18, backgroundColor: 'red'}}/>

This situation is not correct， and it displays mess on 6sPlus:

and  it is like this when resize to 100%:

But if I set the height to even number Or add the radius to the other corner, it displays correct.

RN: 0.33
ios simulator 6p, 10.3

Hello! Please follow the issue template when you file an issue. Additionally, no support is provided for very old versions of React Native -- 0.33 is just about 12 versions behind, which is nearly a year.


search if previousQuery doesn't exist

[x] bug

What you did
i opened the searchbar again and put the last search string into the input field. if i delete this, i get no new searchresult.
Expected Behavior
should be start new search
Actual Behavior
if it is one one character it doesn't start new search after deleting this character.

Could you please expand you point?
Consider pointing code snippets here, on Codepen or on JSFiddle.
Make sure you have read the documentation correctly and followed any instructions it may give.

It would be great if you could confirm my fix. I have not so much time to build a testcase :-( you can test it with phone here: https://www.gayguide.travel/Europa/Deutschland/Berlin
please open the filter and add a character to searchbar, then close the filter and open again. now it's possible to remove this character and the search start now.


Stop using our Docker repositiry in the manifest

Because it will go away soon in favor of
https://github.com/heremaps/oss-review-toolkit/pull/1123
Signed-off-by: Sebastian Schuberth<EMAIL_ADDRESS>

Once merged, I'll also change the according test in ORT.


Missing device configuration: Aeotec Illumino Wall Switch

Checklist

[X] It is not in the configuration DB

[X] It was not merged recently or has a pending PR

Which device is missing?
Aeotec Illumino Wall Switch
Manufacturer ID
0x371
Product Type
0x103
Product ID
0x26
Firmware Version
1.4
Is the device listed on the Z-Wave Alliance website?
https://products.z-wavealliance.org/products/4273
Do you have a manual?
https://help.aeotec.com/support/solutions/articles/6000247459-illumino-wall-switch-user-guide

@zwave-js-bot import config 4273 from zwa

The bot has created a PR for this file with a starter template. This needs to be cleaned up however to match our requirements.
If you'd like to help with that, you can create a PR onto the target branch import-config-1632291810.


Use logger for backend, reduce redundant logs to the Ingest Dd

logs are always costly
it's true with Dd as well

cost est $120 / m


General Question for better understanding

What kind of rate limiting algorithm is being leveraged here? (Ex. Token Bucket, Sliding Window etc)
If we go with Redis as our data storage, does it come with the feature of distributed locking?
If not, how do we enable the same since persisting the rate limit headers are not within our reach?
Is client side rate limiting also possible?
If let's say a particular IP/host has to be blacklisted, is there a way we could just enable it on the fly and avoid manual reboot by reconfiguring rate limit properties of Zuul api gateway service?

Best Regards,
Akshay

@marcosbarbero any update on this please?

@lchayoun please review

I'm sorry for the delay, I'm currently on a road trip and have very limited internet connection.
I will get back to you early next week.

Sure. have few more questions around this
have created a separate issue for the same.
https://github.com/marcosbarbero/spring-cloud-zuul-ratelimit/issues/510
Please have a look at the above

@marcosbarbero @lchayoun any update on this?

Hi @akshaydk-buku sorry for the long time to get back to you, I'll try to answer your questions here:

What kind of rate-limiting algorithm is being leveraged here? (Ex. Token Bucket, Sliding Window etc)
It uses Token Bucket.

If we go with Redis as our data storage, does it come with the feature of distributed locking?
It depends entirely on how you configure your Redis cluster.

Is client-side rate limiting also possible?
This library only does server-side rate limiting.

If let's say a particular IP/host has to be blacklisted, is there a way we could just enable it on the fly and avoid manual reboot by reconfiguring rate limit properties of Zuul api gateway service?
This library relies on Spring Boot's Autoconfiguration and its ability to refresh configuration on the fly.

Hi @marcosbarbero Thanks for you reply.
However, we're not using Spring Cloud Config Server and rather are fetching configuration properties from AWS SSM.

As soon as you use a refresh strategy supported by Spring Boot, it will work using this project as well.


How can I add connections to an SFTP server to the Service Map?

My GoLang AWS Lambda connects to an SFTP server and uploads a file to it.
It uses golang.org/x/crypto/ssh and github.com/pkg/sftp to do so.
How should I instrument the Go code to have these connections on the APM Service Map?

Hey @gcobr, thanks for reaching out! You'll need to create a custom subsegment using the Xray SDK: https://docs.aws.amazon.com/xray/latest/devguide/xray-sdk-go-subsegments.html. You will likely need to wrap the function that calls the SFTP server, in your case. Feel free to keep us posted on your progress or reach out to our support team.

@gcobr I'm going to close this ticket for now, as there is nothing we can do immediately here. If the suggested approach does not work, feel free to open a ticket with our support or find us directly in our community slack channel https://datadoghq.slack.com/channels/serverless/.


Archetypes are broken

Running "hugo new" or any other 'hugo" command from the hugo folder or elsewhere is broken because we keep half the config within the gulpfile.
May need to add a "gulp new" task that runs hugo. Doesn't feel right though.

Alternatively write out config to hugo/config.toml
Does baseurl specified on command line override that specified in config.toml?

Yes, baseurl given on the command line overrides that in config.toml. So specify the default localhost:3000 baseurl in config.toml and only override for stage and live runs. Allows this to work:
cd hugo
hugo new archetype-name/content-page.md

Fixed in a606b1c


Add local module dependency to Ballerina.toml

Purpose
Fixes #35645

I'm not getting the code action for the following case. Can you verify.

Fixed


if-run not installed

Description of the Error
I'm trying a clean install of the Impact Framework (using the -g global install), following the installation guide here:
https://if.greensoftware.foundation/users/quick-start
On both Windows 10, Ubuntu 22.04.3 LTS running in WSL, and a freshly installed Fedora 40 Workstation the install goes well and I do not get any errors. However, it looks like only if-diff is added to the path and checking if-run does not appear to be installed anywhere. (Could not find it with locate on the Fedora box).
Could well be I'm doing something wrong or the docs need updating - I'm happy to help with that if I can! :-)
Expected Behaviour
if-run is installed and available on the path and can be run.
Actual Behaviour
Only if-diff is present on the path. if-run results in a command not found.
Steps to Reproduce
Just run npm install -g @grnsft/if then try restarting the shell and running if-run.
Link to online environment
N/A
Manifest File That Generated the Error
N/A
Links to Any Additional Code
N/A
Runtime Info
Tried this with clean installs on:
Windows 10 running node v20.11.1 using PowerShell Core terminal
Ubuntu 22.04.3 LTS in WSL with node v18.18.2 bash
Fedora 40 Workstation with default (dnf installed) node v20.12.2 bash

Hi @petecliff - yes, if you are still on the latest full release you still need to run ie not if-run.
Our docs have been slightly ahead of the actual release for a couple of days as our testing took a little longer than expected - you can either use ie, install the v.0.4.0-beta release or wait until later today for the full release to catch up to the docs!

Cool - thanks @jmcook1186 - no worries. Happy to wait for the full release. Thanks for the speedy update! Much appreciated.


adding in gitignore file to match other controllers

Issue #, if available:
N/A
Description of changes:
adding in an initial gitignore file that matches other controllers
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
Signed-off-by: Adam D. Cornett<EMAIL_ADDRESS>

/ok-to-test

/lgtm


Compute word boundary flags in start state.

At some point, I think I had convinced myself that we didn't need to
compute word boundary flags for the initial state, but it turns out that
we do.
Fixes #271

@bors r+

:pushpin: Commit 8d764ea has been approved by BurntSushi

:hourglass: Testing commit 8d764ea with merge e2f0850...

:sunny: Test successful - status-appveyor, status-travis
Approved by: BurntSushi
Pushing e2f085074c8ca81e42bafb251e81a19ccc56c586 to master...


Using with custom remote server

I am running a GItLab server and I need to teach people git. I really like git-it. Is it possible to use my own remote git server instead of GitHub?

It is possible.
You'd need to set up your own bot, basically fork (or re-write) jlord/reporobot and wire it up to work with whatever Git API and repositories you want to use (right now it uses the GitHub API and jlord/patchwork as the base repo). You'd then need to fork Git-it to send requests to your server.


test on macos

Codecov Report
Base: 100.00% // Head: 100.00% // No change to project coverage :thumbsup:

Coverage data is based on head (1f7e623) compared to base (c55010e).
Patch has no changes to coverable lines.

:exclamation: Current head 1f7e623 differs from pull request most recent head 0da451a. Consider uploading reports for the commit 0da451a to get more accurate results

Additional details and impacted files
@@            Coverage Diff            @@
##            master       #20   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            5         5
  Lines          238       238
=========================================
  Hits           238       238

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


MNIST application is not deterministic

MNIST application with just fc layer and loss run over 10 times does not start from the same location.
This might be issue of data loading or network or some initialization and needs quick fix.
I think @zhoonit saw this kind of similar bug in his sample application too.

:octocat: cibot: Thank you for posting issue #464. The person in charge will reply soon.

This un-deterministic behavior is also there on nntrainer_capi_nnmodel.train_with_file_01_p unittest.

@jijoongmoon If you have verified this, please close.

fixed by #522


Bug in backward pass of FlowProjectionLayer

Hi, great work, well done!
I noticed bug in one of your custom packages, FlowProjectionLayer. Specifically, in line 43 of the file FlowProjectionLayer.py, tensors input1 and count are saved in the graph, but in the backward function on line 61, an additional variable output is included, which causes a ValueError.
Thanks.

I think that should be ``'input1, count = ctx.saved_tensors'.


OHRI-224 Add Covid case Form Question

Added all covid case form questions and package structure for the form.

open PR to working instead


Environment variable not being saved after copy/paste

Describe the bug
The value of the environment variables are not saved if you just copy/paste and don't type into the json area.
To Reproduce

Go to 'Manage Environments'
Create a new pair variableA/valueA
Click 'Done'
Go back to 'Manage Environments'
Copy some valueB (from notepad for example)
Paste as valueB over valueA  (just paste, do not type anything)
Click 'Done'
Go back to 'Manage Environments'
See that the value of variableA is still valueA

Expected behavior
The value of variableA should be valueB.
Desktop (please complete the following information):

OS: Windows 10
Installation Method: update and download
App Version: 2020.03.0

I'm having the same problem when pasting the token into the Bearer.
Desktop (please complete the following information):

OS: Windows 10

Installation Method: update and download

App Version: 2020.03.0

A workaround is to type something and just delete it.

This seems to be happening across the whole app. I am also experiencing it in the Query Variables section for GraphQL requests. After pasting in a new value, it keeps the old value even though the display has been updated. The workaround from @marcellorvalle does work here as well.

As @marcellorvalle mentioned, I followed this steps:

click the field and type something;
click out of the field;
click the field again and paste your content right after the content typed;
click out of the field and it should work;
then just clean the previosly typed content;

I tried to paste right before the typed chracters, same fail.

I'm experiencing the same issue. Pasting anything in the environment doesn't stick, only if I manually type something then paste then it gets saved.

Duplicate of #2377

This is still an issue, even though #2377 is closed since long.
In my case I have a a reponse tag in the request which was not saved when closing the Environments page.
I had a look in the insomnia.Environment.db file and there where lines like the one below.
However, when just changing the response tag to set request etc, a new line was added, but without the request reference.
When I added the property "blabla" in the environment it started working again.
`{"_id":"env_49bfc291c9dd4ced8177a0408178de94","type":"Environment","parentId":"env_09d97291147b89c5e9ca04bc139c1e48e1d22dc8","modified":1673618345835,"created":1673592277671,"name":"test","data":{"scheme":"https","base_path":"","host":"api-vera-test.collectordev.se","bearerToken":"{% response 'body', 'req_42d314e4f2a74e13845f92ff35f50b75', 'b64::JC5hY2Nlc3NfdG9rZW4=::46b', 'never', 60 %}","tokenUrl":"XXX","blabla":"aa"},"dataPropertyOrder":{"&":["scheme","base_path","host","bearerToken","tokenUrl","blabla"]},"color":null,"isPrivate":true,"metaSortKey":1673591907088}
`
Version: Insomnia 2022.7.2
Build date: 1/12/2023
OS: Windows_NT x64 10.0.19044
Electron: 22.0.0
Node: 16.17.1
V8: <IP_ADDRESS>-electron.0
Architecture: x64

Wouldn't a simple 'save' button do it, this behavior is really annoying and trying to make the app smart just makes it seem dumb


Improve size display of colocalisation bubbles

The section "Gene prioritisation using colocalisation analysis" displays circles / bubbles for each gene-tissue that was tested for coloc with a trait. The size of these bubbles currently relates to the log2(H4/H3) outputs from coloc.
This is nice, but it has the effect that sometimes one coloc test has a much higher log2(H4/H3) than others, even though all have strong evidence of colocalisation. As a result, most bubbles show very small, even when there is strong evidence of coloc.
This is the example that made me think about it:
https://dev--genetics-app.netlify.app/study-locus/GCST90002310/10_69334748_T_C
Here you see that there is a strong coloc for HK1 in the FAIRFAX_2012 dataset: log2(H4 / H3) = 6.87, and H4 = 0.989. But the dot appears tiny because another QTL shows a very strong coloc.
For display purposes, I would cap the max abs(log2(H4/H3)) used in the display to 7, i.e. H4 is about 100 times more likely than H3 (2^7 = 128). This way a bubble with coloc log2(H4/H3) of 7 would have the same size as one with log2(H4/H3) of 20.

For context, this isn't an issue for most loci, so not a very high priority.

Here is another example, where the LACK of coloc in one dataset (very high negative log(H4/H3)) causes all of the other bubbles to be small.
https://genetics.opentargets.org/study-locus/GCST002222/1_109274968_G_T

Ticket closed as work completed and merged into v6 release


Enhancement: WH Alias in more places.

Non critical, but for real convenience, in both the Map Information window, where systems are listed, if whatever Alias has been assigned could be included either as another column, or before/after the J-Sig, it would make identifying systems in the list more efficient.
Additionally, if you have given a WH an alias, when you delete the WH, the deletion confirmation box only asks you to confirm the J-Sig, adding the Alias to the dialog box would make verifying what you're about to delete more comforting.

Great idea. Usually we manually enter in the connection details into the info field in the signature list
Current system - Leads to (example: c1a-c2c)
If you could populate the details as current system label - connected system label  I think that would be valuable to keep the info upto date.

Is it possible to make a two way functional change? so say we remove a sig off the mapping area it will also remove the associated sig from the signatures list?

Not yet. There have to be made some major changes to the DB-Schema and how connections are connected with signatures. There is already an issue for that feature.

This looks fantastic - you're a hero.

Awesome man, Thanks