#161420522 Further Code refactor

What does this PR do?
This PR refactors the code further
Description of Task to be completed?
Reduce the use of return statements and duplicated code
How should this be manually tested?
Clone the repo using git clone
Open the folder store-manager-api and switch to the ch-dry-validation-161420522 branch
Install the dependencies by doing pip intall -r requirements.txt
Install a virtual environment by doing pip install virtualenv
Create virtual environment python virtualenv env
Activate the virtual environment by doing env/bin/activate
Then export FLASK_APP=run.py
Then python run.py to run
Copy the localhost address or the Heroku link into Postman and test using the documentation guide
Any background context you want to provide?
Follow all the steps listed in running the app
What are the relevant pivotal tracker stories?
#161420522
Screenshots (if appropriate)
None
Questions:
Open for questions

Pull Request Test Coverage Report for Build 68

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 92.055%

Totals

Change from base Build 63:
0.0%

Covered Lines:
336

Relevant Lines:
365

💛  - Coveralls


chafa: Unknown option -f when using lf

met this issue after installed chafa and ctpv in ubuntu:
apt install chafa libmagic-dev
git clone https://github.com/NikitaIvanovV/ctpv
cd ctpv
make
sudo make install

lfrc:
set previewer ctpv
set cleaner ctpvclear
&ctpv -s $id
&ctpvquit $id

# Basic Settings
set hidden true
set ignorecase true
set icons true

# Custom Functions
cmd mkdir ${{
  printf "Directory Name: "
  read ans
  mkdir $ans
}}

cmd mkfile ${{
  printf "File Name: "
  read ans
  nvim $ans
}}

# Archive bindings
cmd unarchive ${{
  case "$f" in
      *.zip) unzip "$f" ;;
      *.tar.gz) tar -xzvf "$f" ;;
      *.tar.bz2) tar -xjvf "$f" ;;
      *.tar) tar -xvf "$f" ;;
      *) echo "Unsupported format" ;;
  esac
}}

# nvim
cmd open_nvim ${{
    nvim
}}
cmd open_nvim_file ${{
    nvim "$f"
}}

# fuzzy finder
cmd fzf_jump ${{
    res="$(find . -maxdepth 1 | fzf --reverse --header='Jump to location')"
    if [ -n "$res" ]; then
        if [ -d "$res" ]; then
            cmd="cd"
        else
            cmd="select"
        fi
        res="$(printf '%s' "$res" | sed 's/\\/\\\\/g;s/"/\\"/g')"
        lf -remote "send $id $cmd \"$res\""
    fi
}}

map <c-f> :fzf_jump
map E :open_nvim
map e :open_nvim_file

# Bindings
map d
map m

map c $vscodium "$f"

map au unarchive
map ae $wine "$f"

# Basic Functions
map . set hidden!
map dd trash
map dr restore_trash
map p paste
map x cut
map y copy
map <enter> open
map <backspace2> :updir
map J :updir; down; open
map K :updir; up; open
map R reload
map mf mkfile
map md mkdir
map bg setwallpaper
map C clear
map S shell

# Movement
map gn cd ~/.config/nvim
map gl cd ~/.config/lf
map gw cd ~/work
map gh cd ~
map ga cd ~/app
map gt cd ~/.local/share/Trash/files

then this happend:

i don't know why, is it about the version of chafa? i'm using apt install in ubuntu:
❯ chafa --version
Chafa version 1.2.1

Features: mmx sse4.1 popcnt
Applying: mmx sse4.1 popcnt

Copyright (C) 2018 Hans Petter Jansson et al.
Incl. libnsgif copyright (C) 2004 Richard Wilson, copyright (C) 2008 Sean Fox

This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

it's about the version
ubuntu's apt always seems to have trouble with version updates🤔

I think I should look into building ctpv with libchafa or something because I have to use some more recent features which are available on odd versions shipped with Ubuntu.
I will look into it and close the issue once it's fixed.
By the way, have you managed to get around this problem?

By the way, have you managed to get around this problem? l
yes, i download the latest version from  chafa's github release, and it works now


Add extensions/api.d.ts to .eslintignore

Signed-off-by: Lauri Nevala<EMAIL_ADDRESS>

Can we use existing .eslintrc.js for that purpose?

Yes, ignorePatterns seems to do the same. Will update the PR using that.


bad format exception websockets client crashes

I used the example code to try and connect to this Connection URL: wss://ws.blockchain.info/inv
API described here https://blockchain.info/api/api_websocket
The client returns a 400 status code ( bad format exception ).
websockets.exceptions.InvalidStatusCode: Status code not 101: 400
wsuri.resource_name = '/inv' ( when tracing the code)

I cant see what i am doing wrong, because the equivalent code when I am using  this library https://github.com/websocket-client/websocket-client works....
I also tested the module against wss here http://websocket.org/echo.html and it work. The only difference is that there was no resource name.

This endpoint works for me:
>>> import asyncio
>>> import websockets
>>> ws = asyncio.get_event_loop().run_until_complete(websockets.connect('wss://ws.blockchain.info/inv'))
>>> ws.state_name
'OPEN'
>>> asyncio.get_event_loop().run_until_complete(ws.send('{"op":"ping"}'))
>>> asyncio.get_event_loop().run_until_complete(ws.recv())
'{"op":"pong"}'
>>> asyncio.get_event_loop().run_until_complete(ws.close())
>>> ws.state_name
'CLOSED'

I can't see what you are doing wrong either because you didn't include the failing code in your bug report and my crystal ball is momentarily out of order.

Hi @aaugustin, i ran the code you pasted and it still did not work :(
Python 3.6.2 |Anaconda, Inc.| (default, Sep 19 2017, 08:03:39) [MSC v.1900 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import asyncio
>>> import websockets
>>> ws = asyncio.get_event_loop().run_until_complete(websockets.connect('wss://ws.blockchain.info/inv'))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\ProgramData\Anaconda3\lib\asyncio\base_events.py", line 467, in run_until_complete
    return future.result()
  File "C:\ProgramData\Anaconda3\lib\asyncio\tasks.py", line 537, in _wrap_awaitable
    return (yield from awaitable.__await__())
  File "C:\ProgramData\Anaconda3\lib\site-packages\websockets\py35\client.py", line 19, in __await__
    return (yield from self.client)
  File "C:\ProgramData\Anaconda3\lib\site-packages\websockets\client.py", line 215, in connect
    extra_headers=extra_headers)
  File "C:\ProgramData\Anaconda3\lib\site-packages\websockets\client.py", line 125, in handshake
    raise InvalidStatusCode(status_code)
websockets.exceptions.InvalidStatusCode: Status code not 101: 400

Windows 10 64bit
python 3.6.2. I am using anaconda python
asyncio (3.4.3)
websockets (3.4)
What more information can i give you?

For some reason that server returns a "400 Bad Request" error code instead of accepting the connection.
You should review the documentation of the service to see in which circumstances they return that error.


Update index.html

Add Service Bus JMS support

Also update links to https://docs.microsoft.com/en-us/azure/java/


Prioritize What Models need to be moved to 2.0 DSPEC

https://docs.google.com/spreadsheets/d/1eV9fRGkZnrJYPFxOCErO9p_oEVL2Mu1whJM-uyYW-30/edit?usp=sharing


iOS VoiceOver disrupts the lifecycle of platform views

Reproduction with Youtube API + Webview Flutter plugin:
import 'dart:async';
import 'dart:convert';

import 'package:flutter/material.dart';
import 'package:webview_flutter/webview_flutter.dart';

void main() => runApp(MyApp());

class MyApp extends StatelessWidget {
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      home: MyHomePage(title: 'Flutter Demo Home Page'),
    );
  }
}

class MyHomePage extends StatelessWidget {
  MyHomePage({Key key, this.title}) : super(key: key);

  final String title;

  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: Text(widget.title, style: TextStyle(fontFamily: 'ProductSans')),
      ),
      body: Center(
        child: TextButton(
          onPressed: () => _launchVideo(context), child: Text('Launch Video'),
        ),
      ),
    );
  }

  Future<void> _launchVideo(BuildContext context) async {
    await Navigator.push(
        context,
        MaterialPageRoute(
          fullscreenDialog: true,
          builder: (context) => _buildPopover(context),
        ));
  }

  Widget _buildPopover(BuildContext context) {
    return OrientationBuilder(
      builder: (context, orientation) {
        final isPortrait = orientation == Orientation.portrait;
        return Scaffold(
          appBar: isPortrait
              ? AppBar(
            title: Text('Video', ),
            leading: IconButton(
              icon: Icon(Icons.close),
              onPressed: () async {
                await Navigator.of(context).maybePop();
              },
            ),
          )
              : null,
          body: Container(
            decoration: BoxDecoration(
              color: Colors.black,
            ),
            child: SafeArea(child: YoutubePlayerWidget()),
          ),
        );
      },
    );
  }
}

const _userAgent =
    'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36';
const _aspectRatio = 16 / 9;

/// A youtube player widget which interacts with the underlying webview
/// to play YouTube videos.
class YoutubePlayerWidget extends StatefulWidget {
  @override
  _YoutubePlayerWidgetState createState() => _YoutubePlayerWidgetState();
}

class _YoutubePlayerWidgetState extends State<YoutubePlayerWidget> {
  @override
  Widget build(BuildContext context) {
    return AspectRatio(
        aspectRatio: _aspectRatio,
        child: IgnorePointer(
          ignoring: false,
          child: WebView(
            key: widget.key,
            userAgent: _userAgent,
            initialUrl: _player,
            javascriptMode: JavascriptMode.unrestricted,
            initialMediaPlaybackPolicy: AutoMediaPlaybackPolicy.always_allow,
          ),
        ));
  }

  String get _player {
    final _player = '''
    <!DOCTYPE html>

        <meta name='viewport' content='width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no'>

    ''';
    return 'data:text/html;base64,'
        '${base64Encode(const Utf8Encoder().convert(_player))}';
  }
}

Steps:

Tap launch video.
After the video starts playing, enable picture-in-picture mode by tapping on this icon:

Tap close button.

Observe that the video stops and the platform view is gone.
Now enable voiceover and repeat the same steps. You will see that after tapping close, the video continues to play. The dispose logic of platform view is not executed correctly with voiceover on.

flutter doctor -v
[✓] Flutter (Channel stable, 1.22.5, on Mac OS X 10.15.4 19E2269 darwin-x64,
    locale en-IN)
    • Flutter version 1.22.5 at /Users/dhs/documents/Fluttersdk/flutter
    • Framework revision<PHONE_NUMBER> (5 weeks ago), 2020-12-10 11:54:40 -0800
    • Engine revision ae90085a84
    • Dart version 2.10.4

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.0)
    • Android SDK at /Users/dhs/Library/Android/sdk
    • Platform android-30, build-tools 30.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.0.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.0.1, Build version 12A7300
    • CocoaPods version 1.9.3

[!] Android Studio (version 4.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)

[✓] VS Code (version 1.52.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.16.0

[✓] Connected device (3 available)
    • sdk gphone x86 64 arm64 (mobile)    • emulator-5554
      • android-x64 • Android 11 (API 30) (emulator)
    • Deepti 's iPhone (mobile)           •
      0554e90e563e81fd41bfd2ff9a2c6960595b9825 • ios         • iOS 12.4.9
    • iPhone SE (2nd generation) (mobile) • 6C85835D-FBFD-4AB3-8DE8-B4FAD35E5367
      • ios         • com.apple.CoreSimulator.SimRuntime.iOS-14-0 (simulator)
    ! Error: Deepti 's iPhone is busy: Copying cache files from device. Xcode
      will continue when Deepti 's iPhone is finished. (code -10)

! Doctor found issues in 1 category.
dhs@Dhss-MacBook-Pro ~ % flutter doctor -v
[✓] Flutter (Channel stable, 1.22.5, on Mac OS X 10.15.4 19E2269 darwin-x64,
    locale en-IN)
    • Flutter version 1.22.5 at /Users/dhs/documents/Fluttersdk/flutter
    • Framework revision<PHONE_NUMBER> (5 weeks ago), 2020-12-10 11:54:40 -0800
    • Engine revision ae90085a84
    • Dart version 2.10.4

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.0)
    • Android SDK at /Users/dhs/Library/Android/sdk
    • Platform android-30, build-tools 30.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.0.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.0.1, Build version 12A7300
    • CocoaPods version 1.9.3

[!] Android Studio (version 4.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)

[✓] VS Code (version 1.52.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.16.0

[✓] Connected device (3 available)
    • sdk gphone x86 64 arm64 (mobile)    • emulator-5554
      • android-x64 • Android 11 (API 30) (emulator)
    • Darshan's iphone (mobile)           •
      21150b119064aecc249dfcfe05e259197461ce23 • ios         • iOS 14.2
    • iPhone SE (2nd generation) (mobile) • 6C85835D-FBFD-4AB3-8DE8-B4FAD35E5367
      • ios         • com.apple.CoreSimulator.SimRuntime.iOS-14-0 (simulator)

! Doctor found issues in 1 category.

flutter doctor -v
[✓] Flutter (Channel stable, 1.22.5, on Mac OS X 10.15.4 19E2269 darwin-x64,
    locale en-IN)
    • Flutter version 1.22.5 at /Users/dhs/documents/Fluttersdk/flutter
    • Framework revision<PHONE_NUMBER> (5 weeks ago), 2020-12-10 11:54:40 -0800
    • Engine revision ae90085a84
    • Dart version 2.10.4

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.0)
    • Android SDK at /Users/dhs/Library/Android/sdk
    • Platform android-30, build-tools 30.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.0.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.0.1, Build version 12A7300
    • CocoaPods version 1.9.3

[!] Android Studio (version 4.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)

[✓] VS Code (version 1.52.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.16.0

[✓] Connected device (3 available)
    • sdk gphone x86 64 arm64 (mobile)    • emulator-5554
      • android-x64 • Android 11 (API 30) (emulator)
    • Deepti 's iPhone (mobile)           •
      0554e90e563e81fd41bfd2ff9a2c6960595b9825 • ios         • iOS 12.4.9
    • iPhone SE (2nd generation) (mobile) • 6C85835D-FBFD-4AB3-8DE8-B4FAD35E5367
      • ios         • com.apple.CoreSimulator.SimRuntime.iOS-14-0 (simulator)
    ! Error: Deepti 's iPhone is busy: Copying cache files from device. Xcode
      will continue when Deepti 's iPhone is finished. (code -10)

! Doctor found issues in 1 category.
dhs@Dhss-MacBook-Pro ~ % flutter doctor -v
[✓] Flutter (Channel stable, 1.22.5, on Mac OS X 10.15.4 19E2269 darwin-x64,
    locale en-IN)
    • Flutter version 1.22.5 at /Users/dhs/documents/Fluttersdk/flutter
    • Framework revision<PHONE_NUMBER> (5 weeks ago), 2020-12-10 11:54:40 -0800
    • Engine revision ae90085a84
    • Dart version 2.10.4

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.0)
    • Android SDK at /Users/dhs/Library/Android/sdk
    • Platform android-30, build-tools 30.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.0.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.0.1, Build version 12A7300
    • CocoaPods version 1.9.3

[!] Android Studio (version 4.1)
    • Android Studio at /Applications/Android Studio.app/Contents
    ✗ Flutter plugin not installed; this adds Flutter specific functionality.
    ✗ Dart plugin not installed; this adds Dart specific functionality.
    • Java version OpenJDK Runtime Environment (build
      1.8.0_242-release-1644-b3-6915495)

[✓] VS Code (version 1.52.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.16.0

[✓] Connected device (3 available)
    • sdk gphone x86 64 arm64 (mobile)    • emulator-5554
      • android-x64 • Android 11 (API 30) (emulator)
    • Darshan's iphone (mobile)           •
      21150b119064aecc249dfcfe05e259197461ce23 • ios         • iOS 14.2
    • iPhone SE (2nd generation) (mobile) • 6C85835D-FBFD-4AB3-8DE8-B4FAD35E5367
      • ios         • com.apple.CoreSimulator.SimRuntime.iOS-14-0 (simulator)

! Doctor found issues in 1 category.

/cc @cyanglaz @chunhtai @amirh

/cc @cyanglaz @chunhtai @amirh

(Will require iOS 14 to reproduce on iPhone)

(Will require iOS 14 to reproduce on iPhone)

This is blocking an important feature launch for customer: mulligan.

This is blocking an important feature launch for customer: mulligan.

unassign myself since i won't be able to get to now

unassign myself since i won't be able to get to now

@blasten Any change somebody familiar with the webview plugin could take a look at this?

@blasten Any change somebody familiar with the webview plugin could take a look at this?

Thanks @cyanglaz for taking a look!

Thanks @cyanglaz for taking a look!

Updates:
I am able to reproduce the issue with the example app. I also set up an iOS app without flutter, which mimics how platform view and WebView works. And there is no issue with the iOS app.
So I can confirm this is an issue with flutter but not iOS.
Will keep working on this.

The fix has rolled into the framework at https://github.com/flutter/flutter/commit/b957144136c36f189f00876b71379a0a7cae7efc


UnstructuredLoader: add timeout option

Fixes #1856
Adds a per-request timeout option to the UnstructuredLoader, allowing a timeout different from 5 minutes to be passed to the constructor.

Thanks for submitting this - would really like to avoid adding an additional dependency. Can we do this in base fetch?

Not that I'm aware of. Since Node18 node fetch is internally implemented with undici (mantained more or less by the same node core team) and for the dispatcher you need to instantiate at least an Agent, which is an exported undici class.
See this discussion for reference.

Unfortunately in this case we need to support more than Nodr (Edge functions, CF Workers, Deno).

Unfortunately in this case we need to support more than Nodr (Edge functions, CF Workers, Deno).

Totally missed the portability concerns... I'll scout about it and report back.


[RESOLVED] Interface eth0(): High error rate (>2 for 5m)

Problem started at 09:06:29 on 2023.04.19
Problem name: Interface eth0(): High error rate (>2 for 5m)
Host: S100-Primario
Severity: Warning
Operational data: errors in: 3, errors out: 0
Original problem ID: 19743
Event details in Zabbix: http://<IP_ADDRESS>/tr_events.php?triggerid=23483&eventid=19743

Problem has been resolved in 6m 0s at 09:12:29 on 2023.04.19
Problem name: Interface eth0(): High error rate (>2 for 5m)
Host: S100-Primario
Severity: Warning
Original problem ID: 19743


GRPCCall must set its state to Started when the call starts.

@jayantkolhe  This is just a bug; there's no API change involved.

GRPCCall.state is not working...


        Due to the size of NetworkX drawing elements, this is only recommended
        for very small skeletons.

        Parameters
        ----------
        csr_graph : SciPy Sparse matrix
            The skeleton graph in SciPy CSR format.
        coordinates : array, shape (N_points, 2)
            The coordinates of each point in the skeleton. ``coordinates.shape[0]``
            should be equal to ``csr_graph.shape[0]``.

        Other Parameters
        ----------------
        axis : Matplotlib Axes object, optional
            The Axes on which to plot the data. If None, a new figure and axes will
            be created.
        image : array, shape (M, N[, 3])
            An image on which to overlay the skeleton. ``image.shape`` should be
            greater than ``np.max(coordinates, axis=0)``.
        **kwargs : keyword arguments
            Arguments passed on to `nx.draw_networkx`. Particularly useful ones
            include ``node_size=`` and ``font_size=``.
        """
        if axis is None:
            _, axis = plt.subplots()
        if image is not None:
            cmap = cmap or 'gray'
            axis.imshow(image, cmap=cmap)
>       gnx = nx.from_scipy_sparse_matrix(csr_graph)
E       AttributeError: module 'networkx' has no attribute 'from_scipy_sparse_matrix'

src/skan/draw.py:402: AttributeError
============================================ warnings summary =============================================
src/skan/test/test_io.py::test_write_excel_tables
  /Users/rly/Documents/NWB/temp/skan/src/skan/io.py:27: FutureWarning: save is not part of the public API, usage can give unexpected results and will be removed in a future version
    writer.save()

src/skan/test/test_pipe.py::test_pipe
src/skan/test/test_pipe.py::test_pipe
  /Users/rly/Documents/NWB/temp/skan/src/skan/pipe.py:51: DeprecationWarning: Starting with ImageIO v3 the behavior of this function will switch to that of iio.v3.imread. To keep the current behavior (and make this warning disappear) use `import imageio.v2 as imageio` or call `imageio.v2.imread` directly.
    image = imageio.imread(filename, format=image_format)

src/skan/test/test_pre.py::test_threshold2d_sauvola
src/skan/test/test_pre.py::test_threshold_2d_niblack
src/skan/test/test_pre.py::test_threshold_2d_median
src/skan/test/test_pre.py::test_threshold_2d_otsu
src/skan/test/test_pre.py::test_threshold_no_method
src/skan/test/test_pre.py::test_threshold_denoise
  /Users/rly/Documents/NWB/temp/skan/src/skan/test/test_pre.py:15: DeprecationWarning: Starting with ImageIO v3 the behavior of this function will switch to that of iio.v3.imread. To keep the current behavior (and make this warning disappear) use `import imageio.v2 as imageio` or call `imageio.v2.imread` directly.
    image = imageio.imread(os.path.join(datadir, 'retic.tif'), format='fei')

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
========================================= short test summary info =========================================
FAILED src/skan/test/test_draw.py::test_networkx_plot - AttributeError: module 'networkx' has no attribute 'from_scipy_sparse_matrix'
================================ 1 failed, 54 passed, 9 warnings in 39.89s ================================

networkx 3, released on Jan 7, 2023, has deprecated from_scipy_sparse_matrix in favor of from_scipy_sparse_array.
See https://networkx.org/documentation/stable/release/release_2.7.html

Added support for the scipy.sparse array interface. This includes to_scipy_sparse_array and from_scipy_sparse_array. In NetworkX 3.0, sparse arrays will replace sparse matrices as the primary interface to scipy.sparse. New code should use to_scipy_sparse_array and from_scipy_sparse_array instead of their matrix counterparts. In addition, many functions that currently return sparse matrices now raise a FutureWarning to indicate that they will return sparse arrays instead in NetworkX 3.0.

Proposed solutions:

stopgap - limit networkx version to be <3.0 in https://github.com/jni/skan/blob/main/setup.cfg#L51
upgrade networkx version to be >=3.0 in https://github.com/jni/skan/blob/main/setup.cfg#L51 and change https://github.com/jni/skan/blob/main/src/skan/draw.py#L402 to use nx.from_scipy_sparse_array
change https://github.com/jni/skan/blob/main/src/skan/draw.py to use nx.from_scipy_sparse_array if networkx version >= 2.7 else use nx.from_scipy_sparse_matrix
set up github actions to run tests daily

Thanks @rly! Yes I noticed in #184 but hadn't had a chance to raise an issue and/or do anything about it. I propose we go to networkx>=3.0 because I consider skan immature enough to be on the bleeding edge for new releases. (Alternatively, I think we could just set networkx>=2.7?)


Improve WAL reading

Reading a 1B sample WAL before:
1630.86user 17.04system 3:43.40elapsed 737%CPU (0avgtext+0avgdata 5897432maxresident)k
23424957inputs+90outputs (1031major+2039558minor)pagefaults 0swaps
After:
383.87user 10.86system 1:00.87elapsed 648%CPU (0avgtext+0avgdata 3766796maxresident)k
23304589inputs+54outputs (6major+1150971minor)pagefaults 0swaps
So that's about 3.75x faster wall time, and 4.25x less CPU.
I also tried putting the WAL reads and decodes in separate goroutines, which didn't help. Nor did avoiding the NumSamples calls.

Found another useful optimisation.
Before:
1708.38user 17.95system 4:05.89elapsed 702%CPU (0avgtext+0avgdata 5887176maxresident)k
23526309inputs+96outputs (831major+2021538minor)pagefaults 0swaps
After:
261.94user 11.54system 1:01.40elapsed 445%CPU (0avgtext+0avgdata 3548828maxresident)k
23106453inputs+60outputs (5major+1092800minor)pagefaults 0swaps
So that's 6.5x less CPU, and 4x faster wall time.
Also, multiple goroutines threads doesn't seem to help.

@brian-brazil any way to add a bench test as well?


merge package from arlac77/npm-package-template

package.json

chore(package<EMAIL_ADDRESS>chore(scripts): cover@#overwrite c8 --temp-directory build/coverage ava && c8 report -r lcov --temp-directory build/coverage
chore(package): add xo from template
chore(package): add nyc from template
chore(package): set $.ava.require='esm' as in template
chore(package): set $.ava.files='tests/-test.js,tests/-test.mjs' as in template
chore(package): set $.ava.extensions='js,mjs' as in template

.travis.yml

chore(travis): merge from template .travis.yml

Coverage remained the same at 100.0% when pulling 92e180a7deffd0c7b927c1e0b535e387d5add9f1 on template-sync-1 into b1e03f6ed488404632926ea347e9edeb40cc8c9d on master.


Add a flag for antctl to print OVS table names only

Add a new flag to print OVS table names only.  Fixes #5810
./antctl get ovsflows --table-names-only

ARPResponder
ARPSpoofGuard
AntreaPolicyEgressRule
AntreaPolicyIngressRule
Classifier
ConntrackCommit
ConntrackState
ConntrackZone
EgressDefaultRule
EgressMark
EgressMetric
EgressRule
EndpointDNAT
IngressDefaultRule
IngressMetric
IngressRule
IngressSecurityClassifier
L2ForwardingCalc
L3DecTTL
L3Forwarding
Output
PipelineRootClassifier
PreRoutingClassifier
SNAT
SNATMark
ServiceLB
SessionAffinity
SpoofGuard
UnSNAT

/test-all

/test-conformance
/test-e2e

/test-conformance
/test-e2e

Hi @antoninbas could you help to check and merge this one. The failed tests were caused by the testbed instead of code.  I rerun them and they are passed.


Watch exits on error

Watch exits when an error is encounted. In this case my script block was
```j

instead of
```js

Fixed via cf79c02d17abb20540405bce175a003b729d4f19! Thanks for reporting this one, @mike-ward :)

Go ahead and update to 0.7.7 npm update -g cleaver

I can confirm the fix works Thanks!

:+1: Glad to hear it!


Bug Report:

Please check for duplicates, similar issues or closed issues with the same problem, as well performing simple troubleshooting steps (such as deleting the export folder if it's an issue with compiling, reinstalling Kade Engine) before submitting an issue.
If you are playing a downloaded version of the game, what operating system are you using?
Windows (x86), Windows (x86_64), Linux, or macOS? Specify below.
windows x64
What version of the game are you using? Look in the bottom left corner of the main menu.
<IP_ADDRESS>
Have you identified any steps to reproduce the bug? If so, please describe them below. Use images if possible.
Happens on any song on default settings.
Please describe your issue. Provide extensive detail and images if possible.
Note movement is very choppy and looks like you are playing on 20 fps with random frame drops even though my machine is overpowered and the fps counter stays at 144. Tried on a 60hz display and same issue, except it stayed on 60 and appeared to be worse.

thats because the notes are stuck on 60 frames for some reason. Kade dev doesnt experience it because he has a 60hz monitor

thats because the notes are stuck on 60 frames for some reason. Kade dev doesnt experience it because he has a 60hz monitor

That's not the issue, the issue is that the framerate of the arrows looks like 20fps with random lag spikes on 144hz and 60hz. I tried it on both kinds of monitors. Also, are they really? because I noticed they are significantly smoother than 60hz on 144hz in previous versions of kade engine.

Solved by restarting my pc and opening the game again, idk what was wrong


module.modulemap Xcode 7.3 (7D175)

Hi,
I'm getting an the following errors when after upgrading to Xcode 7.3
Redefinition of module 'Compression'
Redefinition of module 'Darwin'
Redefinition of module 'os'
Redefinition of module 'libkern'
Could not build Objective-C module 'SQLLite
tried cleaning project, re installing pods but no luck.

Similar issue being tracked in #349 -- I just added some info there that may be helpful.

I have the same issue. This one only happens when I select a Simulator device to run the app.
On my real iPhone, everything is ok

Ran into the same issue +1

Same issue +1
It work for real device but Simulator is down

Same issue +1

+1, but i find the update log with .travis.yml file.

+1 same issue

I've added a pull request from a solution i made for my framework. In the module map i added cpu checks and based on that i include the sqlite header for arm or x86.

+1 issue occurs on Xcode 7.3 stable version (swift 2.2)

If you're using iOS, @fuxx's branch will unblock you, though it still doesn't solve build issues with OS X and tvOS. #349 has an alternative solution. I know workarounds suck, and I'd love to merge an update that fixes CocoaPods for everyone when it's available, but these solutions should allow everyone to get back to building their apps.
I will note that this issue only affects CocoaPods-based installations. CocoaPods is a great tool, but the way it works currently requires a custom module map approach that is more difficult to maintain and unfortunately rather brittle. The other installation methods (submodule, Carthage) will be more stable because they do not depend on this and will also unblock anyone encountering this error.

Would those having issues try this solution? https://github.com/stephencelis/SQLite.swift/issues/380

Following #380 I was able to install using the CocoaPods app (Version 1.0.0.beta.5 (2016.03.14))

Any solution to solve this trouble?

@Tom29 #380 has quite a bit of information on fixes that have worked for some.

Should be fixed via merge of #380.


Latex Command Revamped

Description
A slightly different implementation of the .latex command, hopefully with no memory leaks this time.
see also: #663 #668
Proposed Implementation
Previously, we were using matplotlib to render the latex, which seemed to hold references to the data even after we were done with it if the input contained invalid latex. This led to an increase in memory usage every time there was malformed input, and ultimately the bot would come crashing down because of memory limits on the process. The only way to mitigate it was with manual calls to gc.collect and dels, which was error-prone and hacky.
This time around, I propose that we keep a separate python script for the latex logic, and call into that with asyncio.subprocess. That way, memory usage should return to normal after every invocation, since a new process is created each time. Each process would load matplotlib, render latex, save the output in a cache directory, and die.
Would you like to implement this yourself?

[x] I'd like to implement this feature myself
[ ] Anyone can implement this feature

save the output in a cache directory, and die.

Sadder words have never been written.
Yes, this sounds like a feasible approach. You'd need to find out what the memory footprint is of the process, and what the limit on concurrent subprocesses should be.


Failed Build: Broken promise

Failed build here: https://travis-ci.org/rsocket/rsocket-cpp/jobs/236401561#L3140 and here: https://travis-ci.org/rsocket/rsocket-cpp/jobs/236401562#L3119
I0526 15:10:25.343734 23830 RSocketServer.cpp:72] Starting RSocketServer
I0526 15:10:25.344848 23830 TcpConnectionAcceptor.cpp:83] Starting TCP listener on port 46979 with 2 request threads
I0526 15:10:25.346344 23848 TcpConnectionAcceptor.cpp:103] Listening on <IP_ADDRESS>:46979
I0526 15:10:25.347144 23830 TcpConnectionAcceptor.cpp:111] Shutting down TCP listener
unknown file: Failure
C++ exception with description "Broken promise for type name `St10shared_ptrIN7rsocket16RSocketRequesterEE`" thrown in the test body.
[  FAILED  ] RequestStreamTest.HelloAsync (6 ms)
[----------] 2 tests from RequestStreamTest (19 ms total)

and
[ RUN      ] RequestResponseTest.Hello
I0526 15:12:15.132006 23954 RSocketServer.cpp:72] Starting RSocketServer
I0526 15:12:15.143609 23954 TcpConnectionAcceptor.cpp:83] Starting TCP listener on port 49071 with 2 request threads
I0526 15:12:15.152891 23954 TcpConnectionAcceptor.cpp:111] Shutting down TCP listener
I0526 15:12:15.156368 23959 TcpConnectionAcceptor.cpp:103] Listening on <IP_ADDRESS>:49071
unknown file: Failure
C++ exception with description "Broken promise for type name `St10shared_ptrIN7rsocket16RSocketRequesterEE`" thrown in the test body.
[  FAILED  ] RequestResponseTest.Hello (29 ms)

It is two different tests non-deterministically failing on server shutdown. So it seems there are issues with changes done in https://github.com/rsocket/rsocket-cpp/pull/486

#552 got rid of these test failures.


docs(readme.md): added npm badge

added npm badge

:tada: This PR is included in version 2.0.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


support CRI in agent Deployment scenario

What this PR does / why we need it:
Support CRI in agent Deployment scenario. I missed the deployment in my previous PR and only added it to the daemonset.
Which issue this PR fixes
(optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged)

fixes #

Special notes for your reviewer:
Checklist
[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

[x] DCO signed
[x] Chart Version bumped
[x] Variables are documented in the README.md

/lgtm

/lgtm


<EMAIL_ADDRESS>download via aria2 failed

Scoop Configuration

//# Your configuration here

ERROR Download failed! (Error 1) An unknown error occurredERROR https://www.irfanview.info/files/iview460_x64.zip
referer=https://www.irfanview.info/files/
dir=C:\Users\username\scoop\cache
out=irfanview#4.60#https_www.irfanview.info_files_iview460_x64.zip
https://www.irfanview.info/files/iview460_plugins_x64.zip
referer=https://www.irfanview.info/files/
dir=C:\Users\username\scoop\cache
out=irfanview#4.60#https_www.irfanview.info_files_iview460_plugins_x64.zip


All users & other users field calculation improvements

Currently T-SQL functions return average of rate, rating & value fields.
On business layer, OtherUsersTotal fields are calculated based on these.
And on client-side it does the final calculation.
Instead of this, T-SQL could directly calculate the Totals and send them to the client-side to handle the rest.

Now T-SQL calculates ResourcePoolRate, IndexRating & NumericValue, sum of User level fields.
Business layer doesn't make any other calculation.
Client-side gets Total and calculates the final average.


⚠ SceneTime has degraded performance

In 36a8350, SceneTime ($ST) experienced degraded performance:

HTTP code: 200
Response time: 1943 ms

Resolved: SceneTime performance has improved in 4fa7270 after 7 minutes.


Suggestion: add an example of how to make requests to the deployed AKS service

A customer had an issue with trying to make a request to the deployed AKS service from this example: https://github.com/microsoft/MLOpsPython/blob/master/diabetes_regression/scoring/deployment_config_aks.yml
The issue was with the web service authentication - they weren't sure how to access the authentication key for the service. Additional example or pointer to documentation (e.g. this) could help prevent future confusion.

Can I work on this issue ?


[5.2] Create factory modifiers

i've come to find that I would would like to use factories a little different than is currently available. Currently you can define and defineAs factories.  This works okay, but where I run into issues is where  I have a lot of variable types.  For example, I may have a Blog that has a published_at field and an user_id field.  The Blog can be published or unpublished, and it can have an author or be written by anonymous. I could have a published authored Blog, an unpublished authored Blog, a published anonymous Blog, and an unpublished anonymous Blog.  Currently, I would have to write 5 different factory types for this.
Ideally what I would like is 'modifiers' for each factory. To define them I would:
$factory->define(App\Blog::class, function (Faker\Generator $faker) {
    return [
        'title'        => $faker->word,
        'body'         => $faker->paragraph(2),
        'published_at' => null,
        'user_id'      => null,
    ];
});

$factory->defineModifier(\App\Blog::class, 'published', function (\Faker\Generator $faker) {

    return [
        'published_at' => $faker->dateTime,
    ];
});

$factory->defineModifier(\App\Blog::class, 'authored', function (\Faker\Generator $faker) {

    return [
        'user_id' => $faker->numberBetween(1, 10),
    ];
});

This would allow me to mix and match modifiers as needed.  Then to use the factories I would
factory(\App\Blog::class, 5)->create();
factory(\App\Blog::class, 5)->modifiers('published')->create();
factory(\App\Blog::class, 5)->modifiers('authored')->create();
factory(\App\Blog::class, 5)->modifiers(['authored', 'published'])->create();

I believe this offers a lot more flexibility, and still allows people to do it the current way if they prefer.

See Multiple Factory Types in Model Factories

thanks, I am aware of the multiple factories types.  unfortunately, unless I'm mistaken, they don't allow you to apply multiple 'modifications' to the factory.

wondering if there are any thoughts on this?

am i supposed to fix this @GrahamCampbell or do we let StyleCI handle it afterwards?

Yeh, don't worry about StyleCI. :)

Looking forward to this, pretty neat!

Sorry this took so long. I renamed "modifiers" to "states"... pretty much works the same though 👍

@browner12: Nice. Could you update the docs as well?

no problem. glad it worked out.
was just going to ask, @taylorotwell would you like me to PR a docs update?


OCSP response not successful (6: unauthorized)

Over the last few days I've been encountering the following error
[lua] ssl_certificate.lua:260: set_response_cert(): auto-ssl: failed to set ocsp stapling for **xxx** - continuing anyway - failed to get ocsp response: failed to validate OCSP response (http://ocsp.int-x3.letsencrypt.org): OCSP response not successful (6: unauthorized), context: ssl_certificate_by_lua*, client: <IP_ADDRESS>, server: <IP_ADDRESS>:443

It looks like it's caused when a certificate expires and so we're unable to use OCSP stapling but I'm unsure why it is not renewed correctly in the first place.
nginx version: openresty/<IP_ADDRESS>

lua-resty-auto-ssl
   0.13.1-1 (installed) - /usr/local/lib/luarocks/rocks

lua-resty-http
   0.15-0 (installed) - /usr/local/lib/luarocks/rocks

For now I'm able to resolve by doing the following

Deleting the cert in redis
Deleting the local copy (/etc/resty-auto-ssl/letsencrypt/certs)
restart openresty

Does anyone have any guidance into what could be the issue?
Alternatively, would it be possible to disable OCSP stapling entirely?
Edit.
renew_check_interval is also not set so it should have the default value of one day

If it helps anyone I ended up just writing a script which deletes certs from redis 3 days before they expire.

same issue here. I don't know why some domain renewals failed and others didn't.
anyway, thanks @ronaldgrn for the solution!

@ronaldgrn Im experiencing a similar issue with only a few domains not renewing, its very strange behaviour as it has been working perfectly for the last year.
Would like to add a similar script as a safety precaution. Would you mind explaining/sharing how your script works?
Many Thanks

Hey @phil118 you can check out the following python script https://gist.github.com/ronaldgrn/f1a99fde2f380c7d94233466aa88d8fd
It deletes certs 3 days before they expire.
As a precaution, the script stops if it detects more than 25 expired or near-expired certs on a single run - you may want to edit that to suit your needs.

@ronaldgrn nice one! thanks for that. Im a complete novice at python so thats super helpful.

@ronaldgrn Thx a lot. I have the same problem. to solve this, just run your script in python 3 and restart openstrey.
Nice work.

The issue with the renewing may be solved with https://github.com/auto-ssl/lua-resty-auto-ssl/issues/241#issuecomment-695777480

I had to delete the files in /etc/resty-auto-ssl/storage/file as well to make it work.

I had to delete the files in /etc/resty-auto-ssl/storage/file as well to make it work.

I am experiencing this issue, however I can't reproduce it. Some users report cert validity error, but when I browse the site it's pulling a valid cert. I do get an expiration warning wiht openssl s_client -connect hostname:443 but I can't make much sense out of this...
After deleting certs in /etc/resty-auto-ssl/letsencrypt/certs (I am not using redis) and challenges in etc/resty-auto-ssl/storage/file and restarting openresty, I really don't see new certs being regenerated in that dir, and the browser keeps serving the same valid cert (even after clearing browser cache).


Fix CoAP server sample payload dump function

Fixes payload dump function to handle multi fragments properly. Also fixes coverity issues.
Coverity-CID: 185277
Coverity-CID: 185278

Codecov Report

Merging #7223 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master    #7223   +/-   ##
=======================================
  Coverage   55.03%   55.03%
=======================================
  Files         477      477
  Lines       51743    51743
  Branches     9948     9948
=======================================
  Hits        28476    28476
  Misses      19304    19304
  Partials     3963     3963

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 6f1cff7...41ec74d. Read the comment docs.


I want add a javascript project , in which on typing the name of the color , the color of the UI changes to that color.

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Sir please assign this project to me.

PROJECT DESCRIPTION:
*Project is based on simple js functions.
*here the color changes according to the input color.
*try it out here - https://srinjoy-26.github.io/UI-color-changer/

A similar project already exists.


17268 fix formatter

Q
A

Is bugfix?
yes

New feature?
no

Breaks BC?
no

Tests pass?
yes

Fixed issues
#17268

We can use number_format - it gets both a number and a string and returns a number. So, all we need is single line of code in Formatter class:
    public function asCurrency($value, $currency = null, $options = [], $textOptions = [])
    {

        $value = number_format($value, 10);
...

@GHopperMSK the issue isn't in asCurrency only. It's decimals formatting overall.

Also number_format can not deal with huge numbers.

Also number_format can not deal with huge numbers.

$ php -r "var_dump(number_format(1E-10, 100));"
string(102) "0.0000000001000000000000000036432197315497741579165547065599639608990401029586791992187500000000000000"

It cannot deal with input such as 87,654,321,098,765,440.0000000000.

It cannot deal with input such as 87,654,321,098,765,440.0000000000.

I can't deal with such a number too )

Well, current implementation can and there are tests for it.


Add note about dependency problem/solution

Summary
Added an important note about a command you need to run to install the correct dependencies.
Fixes #16330

OK I moved the warning below the code.

OK I moved the warning below the code.

You need to run the command before running the install command, so we need to add more wording to the warning to make this clear and catch the user's eye before they try running the install command and reporting it as a bug to us.
Can we move it before the introductory text instead?

@dagood what about this? I added a new section named Dependency error with .NET Core 3.1 that happens right after the feed register. I also kept the existing notes but clarified this is run prior to installing 3.1. Hopefully anyone knew here would notice the strong wording of "Dependency error" on that first header and run the command. This also kind of separates things for 2.x or 3.2/5.0 (for future) by indicating this is a problem with 3.1 and therefor if you're installing some other version, the section doesn't apply.


Fixed incorrect byte order for integer types

Fixed issue where 16 and 32 bit integers were not being sent in network order.
This makes use of htons() and htonl() found in  <netinet/in.h> to stay host endianness-agnostic. Since conversion functions don't exist for larger types, the implementation will break for integers with more than 64 bits.
Alternatively, we could implement the byte switching generically with either a union or type punning, but this works for the time being.

Since you designed this to check the byte size of the value, if an int64 is given it might work since it will be converted to network byte order with the same htonll and ntohll functions used for doubles (defined in RoveCommPacket.h). So this might just work!


House Robber 2

Heyy @tanus786 this is a very famous problem from Leetcode
Link : https://leetcode.com/problems/house-robber-ii/
Kindly assign this to be as a part of hacktoberfest 2022.I ll be solving this in C++ language.
Thanks

Sure @kotwani2883 go for it👍

Please assign this to be as a part of hacktoberfest 2022.
I'll upload the code in python

Please assign this to be as a part of hacktoberfest 2022.
I'll upload the code in python

okay


[Bug] Can't start miner Address already in use

🐛 Bug Report
I have no idea what happens, nothing was changed, just from 10 Dec on 00:00 got this error (was sleep) and systemctl can't run it
Steps to Reproduce
thread 'main' panicked at 'Failed to bind listener: Os { code: 99, kind: AddrNotAvailable, message: "Cannot assign requested address" }. Check if another Aleo node is running'
There is no any ran copy of snarkos...
Expected Behavior
Success run
Your Environment
Snarkos 2.0.0 v11
Rust 1.57
Ubuntu 20.04 minimal

was manual connect to node (using cli erg --node) that not exists but actually it could show warning but not fatal error and can't run

link with https://github.com/AleoHQ/snarkOS/issues/1407


cross-subnet mode ,  I added a new node to the kubernetes cluster. The network segment of this node is different from the network segment of the original kubernetes cluster .

cross-subnet mode ,  I added a new node to the kubernetes cluster. The network segment of this node is different from the network segment of the original kubernetes cluster .
kubectl -n kube-system get pods
NAME                                        READY   STATUS    RESTARTS   AGE
calico-kube-controllers-7f6768fdfb-5r56c    1/1     Running   0          65d
calico-node-6zmkn                           1/1     Running   0          34h
calico-node-7wwsh                           1/1     Running   0          24h
calico-node-8jbm9                           1/1     Running   0          34h
calico-node-bzb4s                           1/1     Running   0          34h
calico-node-hq8bg                           1/1     Running   0          34h
calico-node-n9shn                           1/1     Running   0          34h
calico-node-rgqnk                           1/1     Running   0          34h
calico-node-tc96j                           1/1     Running   0          34h
calicoctl node status
Calico process is running.
IPv4 BGP status
+--------------+-------------------+-------+------------+-------------+
| PEER ADDRESS |     PEER TYPE     | STATE |   SINCE    |    INFO     |
+--------------+-------------------+-------+------------+-------------+
| <IP_ADDRESS>  | node-to-node mesh | up    | 2022-03-09 | Established |
| <IP_ADDRESS>  | node-to-node mesh | up    | 2022-03-09 | Established |
| <IP_ADDRESS>   | node-to-node mesh | up    | 2022-03-09 | Established |
| <IP_ADDRESS>  | node-to-node mesh | up    | 2022-03-09 | Established |
| <IP_ADDRESS>  | node-to-node mesh | up    | 2022-03-09 | Established |
| <IP_ADDRESS>   | node-to-node mesh | up    | 2022-03-09 | Established |
| <IP_ADDRESS>   | node-to-node mesh | up    | 2022-03-09 | Established |
| <IP_ADDRESS>  | node-to-node mesh | up    | 2022-03-10 | Established |
+--------------+-------------------+-------+------------+-------------+
calicoctl get ipPool -o yaml
apiVersion: projectcalico.org/v3
items:

apiVersion: projectcalico.org/v3
kind: IPPool
metadata:
creationTimestamp: 2022-01-04T12:34:19Z
name: default-ipv4-ippool
resourceVersion: "14319405"
uid: 31d03d0e-6645-4561-8ee2-c90a4ff4aebc
spec:
blockSize: 26
cidr: <IP_ADDRESS>/16
ipipMode: CrossSubnet
natOutgoing: true
nodeSelector: all()
kind: IPPoolList
metadata:
resourceVersion: "14641912"

new node :
[root@prod-k8s-node08 centos]# route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
<IP_ADDRESS>         <IP_ADDRESS>       <IP_ADDRESS>         UG    0      0        0 ens5
<IP_ADDRESS>       <IP_ADDRESS>         <IP_ADDRESS>   U     0      0        0 ens5
<IP_ADDRESS>      <IP_ADDRESS>         <IP_ADDRESS>     U     0      0        0 docker0
<IP_ADDRESS>  <IP_ADDRESS>         <IP_ADDRESS> U     0      0        0 *
<IP_ADDRESS>  <IP_ADDRESS>         <IP_ADDRESS> UH    0      0        0 cali630f2bd5792
<IP_ADDRESS>  <IP_ADDRESS>         <IP_ADDRESS> UH    0      0        0 cali98c953cecce
<IP_ADDRESS>   <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS>  <IP_ADDRESS>      <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS> <IP_ADDRESS>      <IP_ADDRESS> UG    0      0        0 ens5
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS>  <IP_ADDRESS>      <IP_ADDRESS> UG    0      0        0 ens5
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 ens5
Behavior ：

the new node （prod-k8s-node08）， same subnet segment with ens5 （<IP_ADDRESS>） , pod  address can Normal communication .
the new node （prod-k8s-node08），different subnet segment (10.21.1.x、10.21.2.x)  pod  address  cannot communicate
if  use 10.21.1.x or 10.21.2.x node ping prod-k8s-node08 , then prod-k8s-node08  can communicate pod  address , but a few minutes   Communication failure .

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce (for bugs)

Context

Your Environment

Calico version v3.8.9
Orchestrator version (e.g. kubernetes, mesos, rkt):  1.21.9
Operating System and version:  5.4.168-1.el7
AWS EC2 to Delpoy kubernetes

IIUC, you're saying cross-subnet communications for pods aren't working?
You should check that your firewall is allowing the encapsulated packets and also check to make sure that the packets are indeed being sent over the tunnel.

IIUC, you're saying cross-subnet communications for pods aren't working?
You should check that your firewall is allowing the encapsulated packets and also check to make sure that the packets are indeed being sent over the tunnel.

the packets are indeed being sent over the tunnel.

tcpdump -vvX -i tunl0
03:58:24.640665 IP (tos 0x0, ttl 64, id 47716, offset 0, flags [DF], proto ICMP (1), length 84)
ip-10-244-195-64.ap-south-1.compute.internal > ip-10-244-227-192.ap-south-1.compute.internal: ICMP echo request, id 16914, seq 61, length 64
0x0000:  4500 0054 ba64 4000 4001 c35b 0af4 c340  E..T.d<EMAIL_ADDRESS>0x0010:  0af4 e3c0 0800 d79a 4212 003d 601a 2c62  ........B..=`.,b
0x0020:  0000 0000 89c6 0900 0000 0000 1011 1213  ................
0x0030:  1415 1617 1819 1a1b 1c1d 1e1f 2021 2223  .............!"#
0x0040:  2425 2627 2829 2a2b 2c2d 2e2f 3031 3233  $%&'()*+,-./0123
0x0050:  3435 3637                                4567

how can i  check that your firewall is allowing the encapsulated packets ?

IIUC, you're saying cross-subnet communications for pods aren't working?
You should check that your firewall is allowing the encapsulated packets and also check to make sure that the packets are indeed being sent over the tunnel.

the packets are indeed being sent over the tunnel.

tcpdump -vvX -i tunl0
03:58:24.640665 IP (tos 0x0, ttl 64, id 47716, offset 0, flags [DF], proto ICMP (1), length 84) ip-10-244-195-64.ap-south-1.compute.internal > ip-10-244-227-192.ap-south-1.compute.internal: ICMP echo request, id 16914, seq 61, length 64 0x0000: 4500 0054 ba64 4000 4001 c35b 0af4 c340 E..T.d<EMAIL_ADDRESS>0x0010: 0af4 e3c0 0800 d79a 4212 003d 601a 2c62 ........B..=`.,b 0x0020: 0000 0000 89c6 0900 0000 0000 1011 1213 ................ 0x0030: 1415 1617 1819 1a1b 1c1d 1e1f 2021 2223 .............!"# 0x0040: 2425 2627 2829 2a2b 2c2d 2e2f 3031 3233 $%&'()*+,-./0123 0x0050: 3435 3637 4567

how can i  check that your firewall is allowing the encapsulated packets ?

how can i check that your firewall is allowing the encapsulated packets ?

Network requirements are laid out here: https://projectcalico.docs.tigera.io/getting-started/kubernetes/requirements#network-requirements
You can also check on the receiving node to see if the packets are making it to the remote node's tunnel device.

if use receiving node  ping  remote node ,   communicate tunl can be use , but a few minutes Communication failure .

how can i check that your firewall is allowing the encapsulated packets ?

Network requirements are laid out here: https://projectcalico.docs.tigera.io/getting-started/kubernetes/requirements#network-requirements
You can also check on the receiving node to see if the packets are making it to the remote node's tunnel device.
diags-20220316_074630.tar.gz

diagnostics log  can you help to check it.

how can i check that your firewall is allowing the encapsulated packets ?

Network requirements are laid out here: https://projectcalico.docs.tigera.io/getting-started/kubernetes/requirements#network-requirements
You can also check on the receiving node to see if the packets are making it to the remote node's tunnel device.

@caseydavenport can you help me .

if use receiving node ping remote node , communicate tunl can be use , but a few minutes Communication failure .

I don't understand this.

if use receiving node ping remote node , communicate tunl can be use , but a few minutes Communication failure .

I don't understand this.

thanks for the reply  @caseydavenport
[root@prod-k8s-master01 centos]# kubectl get nodes
NAME                STATUS   ROLES                  AGE   VERSION
prod-k8s-master01   Ready    control-plane,master   81d   v1.21.8
prod-k8s-master02   Ready    control-plane,master   81d   v1.21.8
prod-k8s-master03   Ready    control-plane,master   81d   v1.21.8
prod-k8s-node01     Ready                     81d   v1.21.8
prod-k8s-node02     Ready                     81d   v1.21.8
prod-k8s-node03     Ready                     76d   v1.21.8
prod-k8s-node04     Ready                     40d   v1.21.9
prod-k8s-node05     Ready                     33d   v1.21.9
prod-k8s-node08     Ready                     11d   v1.21.9
[root@prod-k8s-node08 centos]# route -n
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
<IP_ADDRESS>         <IP_ADDRESS>       <IP_ADDRESS>         UG    0      0        0 ens5
<IP_ADDRESS>       <IP_ADDRESS>         <IP_ADDRESS>   U     0      0        0 ens5
<IP_ADDRESS>      <IP_ADDRESS>         <IP_ADDRESS>     U     0      0        0 docker0
<IP_ADDRESS>  <IP_ADDRESS>         <IP_ADDRESS> U     0      0        0 *
<IP_ADDRESS>  <IP_ADDRESS>         <IP_ADDRESS> UH    0      0        0 cali630f2bd5792
<IP_ADDRESS>  <IP_ADDRESS>         <IP_ADDRESS> UH    0      0        0 cali98c953cecce
<IP_ADDRESS>   <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS>  <IP_ADDRESS>      <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS> <IP_ADDRESS>      <IP_ADDRESS> UG    0      0        0 ens5
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS>  <IP_ADDRESS>      <IP_ADDRESS> UG    0      0        0 ens5
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 tunl0
<IP_ADDRESS> <IP_ADDRESS>     <IP_ADDRESS> UG    0      0        0 ens5

node08 is new node add in cluster  ， if use node08  to ping node05  tunl0 address (<IP_ADDRESS>)  Communication failue
but if use node05  ping  node08 tunl0 address (<IP_ADDRESS>)  can Communication
then use node08 ping node05 also can Communication
a few minutes later use node08 ping node05 Communication failure

The communication link can only be used by the old nodes of the cluster, and it will fail after a few minutes.

As Casey mentioned above, I suggest you to run a debug process:

Access from pod (on node05) to pod (on node 08), it will fail according to you description.
Tcpdump to see if the packet going through the tunnel device on node05.
Tcpdump to see if the packet going through the tunnel device on node08.

It is not necessary to ping ip address of the tunnel device on other node at moment

Calico version v3.8.9

Are you really using Calico v3.8.9? if so, you definitely need to upgrade. This is an ancient version and many many bugs have been fixed since then.

The cluster was deployed using version 3.8.9, and now it has been upgraded to 3.21. The problem still exists

Have you allowed IPIP - IP protocol 4 - in your security groups between nodes?
I have seen this behavior in the past on AWS if protocol 94 is used instead of protocol 4.

Have you allowed IPIP - IP protocol 4 - in your security groups between nodes?
I have seen this behavior in the past on AWS if protocol 94 is used instead of protocol 4.

@caseydavenport
this right ， past on all protocol , then can Communication  ，very thanks 。


K9 does neither encrypt nor sign mails using OpenKeychain while decrypting works

I setup K9 to use OpenKeychain. I verified that OpenKeychain can encrypt and decrypt messages using my key. I can decrypt mails in K9. But when I compose an enrypted mail it is not signed and not encrypted at all. Icons are all green indicating that the keys are available for encryption. Even if I chose only to sign the mail it is not signed after I send it. I tested by mailing myself and a friend.
Expected behavior
When composing a mail with encryption I expect it to be encrypted.
Actual behavior
The composed mail is not encrypted. No error can be seen on logcat.
Steps to reproduce

Compose a message to myself with encryption enabled

Environment
K-9 Mail version: 5.300
Android version: 7.0
Account type (IMAP, POP3, WebDAV/Exchange): IMAP

Is the message sent unencrypted or not at all?

The message is sent but not encrypted although it should have been signed and encrypted.
Am 14. Oktober 2017 18:07:56 MESZ schrieb cketti<EMAIL_ADDRESS>
Is the message sent unencrypted or not at all?
--
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub:
https://github.com/k9mail/k-9/issues/2833#issuecomment-336645050

Solved with the newest version of K9. I did not choose the key to use for my account. In the old version I did not get a pop up indicating this. Now I got one and after selecting the key, everything works just fine.
Am 14. Oktober 2017 18:07:56 MESZ schrieb cketti<EMAIL_ADDRESS>
Is the message sent unencrypted or not at all?
--
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub:
https://github.com/k9mail/k-9/issues/2833#issuecomment-336645050


How should we handle new component requests from teams?

Sometimes, we get requests for new patterns from teams using the Design System.
Examples:

Image viewer (with zoom, rotate functionality)
Version/Environment indicator (way to discern test/int from production pages and display the version number)

How should we deal with requests like that in the future, what does the process look like if the request is valid?

Component request issue template
What's the idea behind the request?
Different reason why we could implement a component that should be included (accessibility, shareability). New components always need a discussion in the team
Design System should act as an enabler
Use Teams Channel to let the community participate on new components and ask for ideas/material, also use Open Design System Office Hours
Stakeholders should know the way the Design System works (enabler vs. single source of truth)
When request comes in, ask "what's currently missing in the System that you need to build it"
How do we decide if the functionality should be implemented by the Design System?
Different requests with different background thoughts
Whenever a request comes in, we need to discuss about it
Who's needed to make pattern decisions? Could be a small group that then presents the decision?
It's pretty important that everybody knows what's going on
We can use the Pattern Discussion to ask who's interested into discussing new components
New components should always have at least a dev and a designer assigned, but can also have more than one
Could sometimes be nice to organize a small coffee meeting with the request author or original dev, designer

Actions:

Improve rules
Create issue template specific to new components requests


fixed: manipulate.Iter functions are now wrapping errors correctly

not sure why this freaking travis does not even start. merging


MapTile On-demand load behaviour.

Description
Implement on-demand load behaviour for map tile class.
Technical Description
the tiles should only load when required and otherwise reuse the controls that are no longer active.
Prerequisites

#6

Closed as is no longer required.

Reopened and removed from v1.0.


"Radu Negru" is listed in the drop-down menu

Description:
"Radu Negru" is listed in the drop-down menu alongside its corresponding county and commune, according to the law
Precondition:
The website is up an running.

Step 1
Type "Radu Negru" in the search bar.

Expected results
The location is listed in the drop-down menu as "CSat Radu Negru, CĂLĂRAȘI (Modelu)".


Borderlands 2 [PCSE00383]

App summary

App name: Borderlands 2
App serial: PCSE00383
App version: 1.00

Vita3K summary

Version: v0.1.8
Build number: 3160
Commit hash: https://github.com/vita3k/vita3k/commit/1c009661
CPU backend: Dynarmic
GPU backend: Vulkan

Test environment summary

Tested by: Sam
OS: Windows 10
CPU: AMD 5500u
GPU: AMD  Radeon Graphics
RAM: 6 GB

Issues

Screenshots

Log

Recommended labels

-Intro
-crash

C?

I'm getting this error:
[22:31:50.007] |C| [handle_access_violation]: Unhandled write protected region was valid. Address=0x15FE9000
[22:31:50.008] |C| [unprotect_inner]: VirtualAlloc failed: Attempt to access invalid address.

Working now
https://youtube.com/clip/Ugkx2o1-1PZsaZBW5mOx6rDKNt-LzWnKlcZ7?si=ZAPpem53Q0nzL7zR

Vita3K summary

Version: v0.2.0
Build number: 3546
Commit hash: https://github.com/vita3k/vita3k/commit/ef89d019
CPU backend: Dynarmic
GPU backend: Vulkan

App summary

App name: Borderlands 2
App serial: PCSE00383
App version: 1.00
Test environment summary
Tested by: Sam
OS: Windows 10
CPU: AMD 5500u
GPU: AMD Radeon Graphics
RAM: 6 GB
Screenshots

Log
vita3k.log
Recommended labels
Playable

Issue: Rear pad, Touch Feature missing.
Device: Infinix Note12
CPU: Helio G96

On Android version 12 and Snapdragon 8s gen 3 this game crashes constantly when loading. I use the latest turnip drivers along with double buffer and sometimes that gets the game to boot.
Other drivers or a different memory mapping setting makes it crash, using no memory mapping actually crashing my phone completely one time.
Once you get into the game it works nicely at 60fps, but sometimes when loading menus the game's visuals freeze. To fix that I have to go outside the app and back inside, which makes the visuals work nicely again until opening a menu yet again.
I can upload logs if needed, but I don't really know where to find them or if I should just paste them here as is.
Besides that the DLC are known to be bugged due to being installed in the wrong folder. A user has found a workaround to make it work again, but I believe it would be better if that feature worked as intended from the get go.


Update composer.json

Hi,
Thanks for the pull request. Is there a specific reason you want the 3.* changed to ~3.0 in the composer.json? Unless I'm mistaken, these syntaxes serve the same purpose in this case.

The tilde ~ allows for compatibility with other packages respecting semantic versioning.
with just the wildcard of 3.*, composer may generate errors if say aws-sdk-php had been included by another package using "~3.0"
as an example, in one of our projects we use the aws-sdk-php-laravel pacakge, and which generates errors if required before your package as it uses the SV ~
https://github.com/aws/aws-sdk-php-laravel/blob/master/composer.json

although in theory the wildcard and tilde should produce the same output, the wildcard tends to generate semantic versioning errors more often. I  really don't know why.


Scope of project from command line tool to ffmpeg input device

I think that this project should be changed into 2 separate projects.

An input device for ffmpeg https://ffmpeg.org/ffmpeg-devices.html#Description that can easily be used with existing ffmpeg techniques/filters/etc
A convenient ffmpeg wrapper that uses the above project under the hood

Honestly the project as is makes for a simple run it and it works, but if you try to do anything with the input, change the codec settings, do ffmpeg filters, etc. it looks much less usable. I really only need the top project.
Are the problems I am listing valid? Or am I just misunderstanding how to use the -p command to pass the other ffmpeg options?

I do not think what you suggest is the intentions of this project. You are free to fork the project and make your own changes.

I agree that I can put in the work if that is what I want changed.
@soreau What do you think the intention of this project is? It looks to me like the point is to very slowly feature creep into feature parity with ffmpeg.
The reason I am saying this in an issue here is that I wanted to see if anyone using or working on this project agrees with me, and is unaware of the input device system that ffmpeg has. It really looks like this core useful feature this project provides fits nicely along with x11grab https://ffmpeg.org/ffmpeg-devices.html#x11grab
If no one with the knowledge of wlr-screencopy-v1, etc. here is interested I'll probably try talking with libavdevice/ffmpeg devs and/or do it myself

Does ffmpeg allow external input devices at all (i.e not built-in in ffmpeg)? Is there a simple example of how to do that?

Sadly it looks like ffmpeg does not have a plugin system for the input devices, we may need to ask the ffmpeg-devel mailing list. Looking at https://git.videolan.org/git/ffmpeg.git in the libavdevice folder you can see all the input and output device definitions. I think these probably show the examples on how to do it

Looking at this again, I don't imagine myself doing this. If someone does it, I guess we'll have a project which will supersede wf-recorder entirely.


Add support for the LSF scheduler

I got a couple of requests to implement support for the LSF scheduler. We could do a basic implementation as with PBS that we could test with the Slurm LSF wrappers.

Any progress on this?

Hi @AnibalMG, nothing so far. Our key focus has been in redesigning the configuration of the framework, which will unblock several other issues. I don't know about your bandwidth, whether you would like to contribute this backend. I could guide you through the necessary steps you need to do. It should not be difficult; we recently had an external contribution for a Torque backend in #1172.


Use fetch-everywhere

Hello. I'd like to use this module in React Native. But it's not possible at the moment, because of whatwg-fetch. I've replaced it with fetch-everywhere in my fork. The module supports all kind of environments. I could prepare a PR, what do you think?

fetch-everywhere is not popular, may be exists more common used alternatives?
Anyway whatwg-fetch should die ;)

Please try this popular module https://www.npmjs.com/package/isomorphic-fetch

@nodkz Unfortunately author of that library rejected to adapt it to React Native. It only works in browser and Node. That's why fetch-everywhere was created.

fetch-everywhere is not popular, may be exists more common used alternatives?

I guess fetch-everywhere is not popular because there are not much projects which use React and Relay and share fetching logic between mobile and browser platforms. But since Relay is specific to React, I think it would be fair to include React Native support.

Good. Open PR please with fetch-everywhere. I'll test it on my project, and if all ok I'll bump new version today.
Thanks!!!

Isn't it better to let the user provide their own polyfill if they need it?

@edvinerikson just remove import 'whatwg-fetch';? Good idea!
For browser whatwg-fetch
For node (server-side rendering) node-fetch
And what people use for react-native - ???
Needs for readme.

That's great idea! React Native already includes fetch polyfill.

bumped 1.2.0

@nodkz exactly, this is what Relay does with the default network layer.


Update packages to fix github npm security warnings

Lets go though the same process here we are doing for the browser.
@MillenniumFalconMechanic @frano-m you both should now have access to the github security alerts for this project.
Cheers,
D

Done with Angular work covered by #723.


ocamlPackages.lwt: 5.4.0 → 5.4.1

Motivation for this change
Bug fixes: https://github.com/ocsigen/lwt/releases/tag/5.4.1
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Added a release notes entry if the change is major or breaking
[x] Fits CONTRIBUTING.md.

@ofbord build ocamlPackages.tcpip

@ofborg build ocamlPackages.tcpip

Checked for regressions in the default ocamlPackages set and there don't seem to be any apart from tcpip which failed for me once, but seems like that was due to a flaky test on a busy machine.


[TC-66] - Stores, diffs and fetches CRConfig.json from the db instead of the file system

This is one step toward making TO HA capable (highly-available)

files were merged but asfgit didn't feel like closing this PR so I will do so manually.


Update pt-BR.coffee

Update finish_signup_p and conversion_warning

Coverage remained the same at 63.766% when pulling ca0dea7c772678cf76e9f7153fd18aa7b330f7f2 on mlordelo:patch-1 into e630145e1ceacafa20db81f1ccb112cbc74daa84 on codecombat:master.

Thanks!


SF Symbols & Background Fetch Tweaks

Related to #772 - Updated more icons to use SF Symbols. Changed to using withTint.. so that there is no aliasing.
Fixes #781 - If the user has low power enabled, the background fetch will still reschedule itself but will not perform any network requests to download/process feeds.

FYI, looks like background app refresh is disabled system wide whenever low power mode is enabled. We shouldn't need to do any extra handling.
More info right around the 3:15 mark in this session...
https://developer.apple.com/videos/play/wwdc2019/712/

@philviso You are correct. I've rolled that part of the PR back. Thanks for pointing it out!

@vincode-io d6ea5bd deletes the images that are not used.


Cast number to string Fixes #42

Thank you @rhalff this looks good to me!
Would you want to help maintain this package?

@ndelangen yeah, no problem :-)

@xyc Can you invite @rhalff to collaborate on this repo? 🙇

Published as 2.2.2

@ndelangen Added @rhalff, thanks for the PR!


Account replacement for imgur

Task description
Implement account replacement for Imgur image repository
To do

[ ] Contact @VitaliiKulinskyi    to get secrets from Imgur

[ ] Replace secrets

[ ] Check the system for operability with new Imgur

Estimating

@VitaliiKulinskyi - id for @petro-khanenko


feat(textlint): new find-util with globby

[ ] globby does not have isIgnored function

close #1410

globby issues

If I specify absolute on Windows, the return value is wrong

fast-glob: https://github.com/mrmlnc/fast-glob/issues/379

IgnoreFiles supports globs, so you have to normalizeIgnoreFilePath.
gitignore option is slow because it searches **/.gitignore first

https://github.com/sindresorhus/globby/issues/50


Console client to WebAPI to WCF (Multihop fails) - error Internal server error (500)

https://github.com/IdentityServer/IdentityServer3.Samples/tree/master/source/Multi Hop Delegation (ActAsCustomGrant)
I am using above sample - in this I have replaced WebAPI2 with WCP (ws2007httpfederation) endpoint configured correctly (I can call from console application to WCF using jwt token (which is wrapped as saml token).
However when I call WCF from WebAPI (backend service to service all) it fails with above mentioned exception.

The problem is solved now - it was issue with certificate.


conda develop .  error

Server configuration: linux system, rtx3090.
According to the readme installation environment, execute the conda develop. command and an error message 'ModuleNotFoundError: No module named 'conda_build'' will be reported. But when I try the pip install conda_build command it keeps failing.

Frankly, I never encountered this problem. I did some Google search. It seems there are some issues with the conda-related software. By the way, the library seems to be "conda-build" during installation.

Hi @1105430565, you can try to use conda install conda-build as you may use miniconda instead of anaconda.
Best,
Nan

The problem with conda develop. has been solved, but I have the following problem when running the ‘’make‘’command：

Except that the version of pycocotools is 2.0.7, because version 2.0.4 keeps reporting errors. The versions of other dependent environments are consistent.


execute sometimes returns results from previous call

I'm using pymapd 0.4.0 in jupyter with mapd 4.0.2.  I've seen this happen a few times, and it happened in 0.3.x also.  I just restart the connection or the notebook to work around.

I don't know how to reproduce. One guess would be when a call to execute is killed.

I just saw this too, but then couldn't reproduce. It's definitely around errors or interrupting the kernel.

@mikehinchey I wonder if this is the explanation for this behavior
http://blog.steveniemitz.com/introducing-scales-rpc-python/

FWIW, con.execute does keep state on Cursor under the _result attribute: https://github.com/mapd/pymapd/blob/4665ea704eb7ffabf72048f1cb3519b4497b8830/pymapd/cursor.py#L132
I'm not sure how one would go about debugging this.

Thanks @TomAugspurger. I've been having a lot of issues with pymapd lately, and almost all of them start with "Not sure how to debug this" :(

Could maybe add an except KeyboardInterrupt https://github.com/mapd/pymapd/blob/master/pymapd/cursor.py#L123. Does the mapd API have a way to cancel a running query? May want to do the same in the Cursor.__del__ method, but doing that properly may be tricky.

There is an interrupt thrift method defined, I believe to interrupt a query.

Closing this, since OmniSciDB and pymapd have gone pretty far in 18 months. If this is still an issue, we can re-open this.


Integrate clustering into EM service

Description of new feature
What should the new feature do?  For visual features, include an image/mockup of the expected output.

Integrate clustering

Use MCODE (or maybe some other algo.?) into this service for clustering/bubbles
Assign a cluster ID per node.

Integrate the WordCloud algorithm to be used for label generation.

Depends on:

#10

Motivation for new feature
Describe your use case for this new feature.
This is the main (top-level) algorithm service.

Port MCODE clustering into the EM service
Port WordCloud label generation into EM service. Hardcode reasonable defaults for MVP.

JSON output should include a cluster identifier for each node. Some nodes may be unclustered.
The result JSON should allow for multiple cluster identifiers to allow for new cluster algorithms to be added in the future that can be run simultaneously on the server.

Generally, if it’s a straightforward issue, then it’s probably fine to just post updates in the issue and close it.
This one touches one at lot of other ones downstream, so I agree it would make sense to have a call like you suggested.

On Sep 16, 2022, at 09:51, Mike Kucera @.***> wrote:
This is done. What is the procedure for completed issues? Should I just close it? Should we have a review first? I'm thinking that having a review for features that are near completion might be a good idea. (ie we discuss it quickly on a zoom call if the feature needs a demo, or just in the comments here if it doesn't)
—
Reply to this email directly, view it on GitHub https://github.com/cytoscape/enrichment-map-webapp/issues/13#issuecomment-1249391797, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHRO4ZGARTJCHGMT2DPGYLV6R3ONANCNFSM6AAAAAAQAXHVIA.
You are receiving this because you authored the thread.


[Scheduler] CondorClassAdScheduler doesn't allow modification of PRE_JOB_RANK

In the current implementation of the CondorClassAdScheduler it is not possible to modify the PRE_JOB_RANK in the negotiation process. It is simply assumed that in each scheduler object has a fixed PRE_JOB_RANK.
It would be nice to implement an interpretable class-ad mechanism like it is done for the RANK, instead of the current drone ranking.

Would you please clarify what you mean with modifying the PRE_JOB_RANK during negotiation process? Each negotiator has a predefined PRE_JOB_RANK, that cannot be modified during the process of negotiation.

We considered this already for implementation. The issue is that we currently use a predefined ordering to keep the complexity of the scheduling process bounded. In case we properly add the PRE_JOB_RANK we have to update the values, and do the sorting before actually going on with everything else. This will have a huge impact on the simulation time.
We foresee to provide another type of scheduler that will properly implement the PRE_JOB_RANK but will have a much higher cost than the currently implemented scheduler.
In case you have a great idea on what you actually want to do with the PRE_JOB_RANK, we can prioritise this issue.

Actually, @tfesenbecker already suggested studying this in her thesis, but wasn't able to do so, because of the current implementation. However, I don't see this as high priority at the moment.


feat: add grafana-auth.yml

Reason for PR
i often run multiple instances of the eth-docker (and subsequently, grafana, in a single browser window). However, grafana adds some browser storage value for auth, and personally, i like to just disable auth here. so adding the ability to view the dashboard without auth is a nice feature to have for me so I'm thinking it will be helpful for others too.

I am inclined not to add this to the repo. Disabling auth on Grafana is a security worry; people who want this can always add it themselves and commit the change; and grafana-cloud.yml is designed to send data to a central Mimir, Loki, Grafana stack, whether that's self-hosted or the actual Grafana Cloud.

Another way to achieve this, btw, is to sudo bash into the grafana-config volume and change grafana.ini the way you want it.
Bind-mounting this volume is a little tricky with permissions. Grafana runs as user grafana id 472, and its directories are owned by grafana:root. That's why it's a named volume. You can still get in there and change the contents of grafana.ini


App does not follow system portrait/landscape lock

Please answer the following questions to yourself before submitting the issue

[x] I am running the latest app version
[x] I checked to make sure that issue has not already been filled

Description
The app rotates to and from landscape even through the rotation setting on my phone is set to locked
To Reproduce

Turn off auto rotation systemwide
Enter the app
Rotate phone
App changes orientation

Expected behavior
The app should stay in the systemwide set orientation
Smartphone:

Device: Samsung s22
OS: Android 13, oneUi 5.1

Hello, thank you for reporting about this. Just reproduced this myself, must be something wrong with activity flags

Turns out android:screenOrientation="fullSensor" ignores the orientation lock setting. I'll make a fix asap


chore: update iconset

Chore - Icons - update iconset

Motivation and Context
Update icons with latest from iconset project.
Priority

[ ] 1 - Highest
[ ] 2 - High
[ ] 3 - Medium
[x] 4 - Low
[ ] 5 - Lowest
[ ] 6 - Not a Priority

Types of changes

[ ] Bugfix (non-breaking change which fixes an issue)
[ ] Feature (non-breaking change which adds functionality)
[ ] Component (add a Component as approved dy Design System)
[ ] Docs (add documentation)
[x] Chore (changes that adds small enhancement)
[ ] Breaking (fix or feature that would cause existing functionality to not work as expected)

Component and Fix approval flow to Master branch
A Pull Request to be merged must have two approvals, one from a member of the product team who developed it and another from a member of the dst dev team other than the team representative.

Closing this PR because of a misunderstanding. Postponed to after a decision has been taken next monday.


Performance Issue with Dojo - Finding Filtering

Dear team,
Issue
I am experiencing issues on the SQL performance of DefectDojo Webapplication.
I have a 3000 users, 1000 product types, 3000 products and around 5 million Findings registered in MySQL database.
The biggest performance issue I notice is at "login time"
workaround
I have augmented RAM to 32GB for the database to fit all indexes in memory
It seems it had reduced from 5 minutes waiting for queries to 10-20 seconds.
However, I think this times should be still improved.
analysis
I enabled the slow-query-log and I checked the slow queries
I saw that most of the queries uses a strategy of using EXISTS to filter the authorized/viewable Findings for a Dojo User
For all those queries, SQL EXPLAIN command, basically shows that it scans the full table (5 million records)  :(
The database has all the default Dojo indexes
According to MySQL documentation, EXISTS (subquery) is executed for each and every Finding to determine if it should be included in the SQL results.
https://dev.mysql.com/doc/refman/8.0/en/subquery-optimization-with-exists.html
MySQL evaluates queries “from outside to inside.” That is, it first obtains the value of the outer expression outer_expr, and then runs the subquery and captures the rows that it produces.
tests
The SQL example below gets all Findings for the specific user_id = 558, besides from filtering the "active" findings in the WHERE clause.
I did refactor the query to use INNER JOIN instead of EXISTS to get the authorized viewable Findings
I got splendid results (manual test in MySQL Shell) and EXPLAIN command shows that the new query uses fully the indexes :)
For this "refactored query", at the end, what I understand, is that the INNER JOIN clause gets first all the test_id associated to a user, so it's directly filtered by the indexes and lastly, it performs a SCAN just over a few records for the WHERE clause.
Please.

Do you make any sense out of this?
Do you have any advice on this SQL performance issue?
Does the latest Dojo version has better design/performance?
Do you have any performance metrics available somewhere, so I can compare with mines ?
Should I submit a Pull Request to refactor queries using EXISTS to be INNER JOIN?

Many thanks
Andrés
`# Time: 2022-06-08T11:38:50.795012Z
Query_time: 18.619581  Lock_time: 0.000442 Rows_sent: 25  Rows_examined: 6029876
SET timestamp=1654688330;
SELECT dojo_finding.id, dojo_finding.title, dojo_finding.date, dojo_finding.sla_start_date, dojo_finding.cwe, dojo_finding.cve, dojo_finding.cvssv3, dojo_finding.cvssv3_score, dojo_finding.url, dojo_finding.severity, dojo_finding.description, dojo_finding.mitigation, dojo_finding.impact, dojo_finding.steps_to_reproduce, dojo_finding.severity_justification, dojo_finding.refs, dojo_finding.test_id, dojo_finding.active, dojo_finding.verified, dojo_finding.false_p, dojo_finding.duplicate, dojo_finding.duplicate_finding_id, dojo_finding.out_of_scope, dojo_finding.risk_accepted, dojo_finding.under_review, dojo_finding.last_status_update, dojo_finding.review_requested_by_id, dojo_finding.under_defect_review, dojo_finding.defect_review_requested_by_id, dojo_finding.is_mitigated, dojo_finding.thread_id, dojo_finding.mitigated, dojo_finding.mitigated_by_id, dojo_finding.reporter_id, dojo_finding.numerical_severity, dojo_finding.last_reviewed, dojo_finding.last_reviewed_by_id, dojo_finding.param, dojo_finding.payload, dojo_finding.hash_code, dojo_finding.line, dojo_finding.file_path, dojo_finding.component_name, dojo_finding.component_version, dojo_finding.static_finding, dojo_finding.dynamic_finding, dojo_finding.created, dojo_finding.scanner_confidence, dojo_finding.sonarqube_issue_id, dojo_finding.unique_id_from_tool, dojo_finding.vuln_id_from_tool, dojo_finding.sast_source_object, dojo_finding.sast_sink_object, dojo_finding.sast_source_line, dojo_finding.sast_source_file_path, dojo_finding.nb_occurences, dojo_finding.publish_date, dojo_finding.service, EXISTS(SELECT (1) AS a FROM dojo_product_type_member U0 WHERE (U0.product_type_id = dojo_product.prod_type_id AND U0.role_id IN (1, 2, 3, 4, 5) AND U0.user_id = 558) LIMIT 1) AS test__engagement__product__prod_type__member, EXISTS(SELECT (1) AS a FROM dojo_product_member U0 WHERE (U0.product_id = dojo_engagement.product_id AND U0.role_id IN (1, 2, 3, 4, 5) AND U0.user_id = 558) LIMIT 1) AS test__engagement__product__member, EXISTS(SELECT (1) AS a FROM dojo_product_type_group U0 INNER JOIN dojo_dojo_group U1 ON (U0.group_id = U1.id) INNER JOIN dojo_dojo_group_member U2 ON (U1.id = U2.group_id) WHERE (U2.user_id = 558 AND U0.product_type_id = dojo_product.prod_type_id AND U0.role_id IN (1, 2, 3, 4, 5)) LIMIT 1) AS test__engagement__product__prod_type__authorized_group, EXISTS(SELECT (1) AS a FROM dojo_product_group U0 INNER JOIN dojo_dojo_group U1 ON (U0.group_id = U1.id) INNER JOIN dojo_dojo_group_member U2 ON (U1.id = U2.group_id) WHERE (U2.user_id = 558 AND U0.product_id = dojo_engagement.product_id AND U0.role_id IN (1, 2, 3, 4, 5)) LIMIT 1) AS test__engagement__product__authorized_group, COUNT(CASE WHEN NOT dojo_endpoint_status.mitigated THEN dojo_finding_endpoint_status.endpoint_status_id ELSE NULL END) AS active_endpoint_count, COUNT(CASE WHEN dojo_endpoint_status.mitigated THEN dojo_finding_endpoint_status.endpoint_status_id ELSE NULL END) AS mitigated_endpoint_count FROM dojo_finding INNER JOIN dojo_test ON (dojo_finding.test_id = dojo_test.id) INNER JOIN dojo_engagement ON (dojo_test.engagement_id = dojo_engagement.id) INNER JOIN dojo_product ON (dojo_engagement.product_id = dojo_product.id) LEFT OUTER JOIN dojo_finding_endpoint_status ON (dojo_finding.id = dojo_finding_endpoint_status.finding_id) LEFT OUTER JOIN dojo_endpoint_status ON (dojo_finding_endpoint_status.endpoint_status_id = dojo_endpoint_status.id) WHERE ((EXISTS(SELECT (1) AS a FROM dojo_product_type_member U0 WHERE (U0.product_type_id = dojo_product.prod_type_id AND U0.role_id IN (1, 2, 3, 4, 5) AND U0.user_id = 558) LIMIT 1) OR EXISTS(SELECT (1) AS a FROM dojo_product_member U0 WHERE (U0.product_id = dojo_engagement.product_id AND U0.role_id IN (1, 2, 3, 4, 5) AND U0.user_id = 558) LIMIT 1) OR EXISTS(SELECT (1) AS a FROM dojo_product_type_group U0 INNER JOIN dojo_dojo_group U1 ON (U0.group_id = U1.id) INNER JOIN dojo_dojo_group_member U2 ON (U1.id = U2.group_id) WHERE (U2.user_id = 558 AND U0.product_type_id = dojo_product.prod_type_id AND U0.role_id IN (1, 2, 3, 4, 5)) LIMIT 1) OR EXISTS(SELECT (1) AS a FROM dojo_product_group U0 INNER JOIN dojo_dojo_group U1 ON (U0.group_id = U1.id) INNER JOIN dojo_dojo_group_member U2 ON (U1.id = U2.group_id) WHERE (U2.user_id = 558 AND U0.product_id = dojo_engagement.product_id AND U0.role_id IN (1, 2, 3, 4, 5)) LIMIT 1)) AND dojo_finding.active ) GROUP BY dojo_finding.id ORDER BY dojo_finding.numerical_severity ASC LIMIT 25;`

Hi @andresoviedo thanks for your report. Here are some answers for your questions:

Do you make any sense out of this?

I use PosgtreSQL in production and MySQL partially for development and have not had issues, but don't have the amounts of data you have. So it's hard for me to reproduce it but your detailed investigations seems to make it clear where the problem is.

Do you have any advice on this SQL performance issue?

I am afraid nothing the might work for you. Users with global roles will not use these complicated queries and be much faster. But they can read or write every product with their findings. Switching to PostgreSQL will most likely not be an option for you, otherwise you might have done that already.

Does the latest Dojo version has better design/performance?

No, these queries haven't been changed.

Do you have any performance metrics available somewhere, so I can compare with mines?

See above, no.

Should I submit a Pull Request to refactor queries using EXISTS to be INNER JOIN?

I personally wouldn't know how to do it with Django, but if you have an idea it might be worth a try.

Dear @StefanFl
Thank you for your feedback
Here is 1 fully optimized indexed query that runs with no delay
It is four union queries that gets the 4 possible authorizations 1 user may have for viewing a finding
I will do my best to continue contributing on this matter...
`
OPTIMIZED QUERY
SELECT distinct dojo_finding.cwe
FROM dojo_finding
INNER JOIN dojo_test ON (dojo_finding.test_id = dojo_test.id)
INNER JOIN dojo_engagement ON (dojo_test.engagement_id = dojo_engagement.id)
INNER JOIN dojo_product ON (dojo_engagement.product_id = dojo_product.id)
INNER JOIN dojo_product_type_member
ON (dojo_product_type_member.product_type_id = dojo_product.prod_type_id
AND dojo_product_type_member.role_id IN (1, 2, 3, 4, 5)
AND dojo_product_type_member.user_id = 542)
UNION
SELECT distinct dojo_finding.cwe
FROM dojo_finding
INNER JOIN dojo_test ON (dojo_finding.test_id = dojo_test.id)
INNER JOIN dojo_engagement ON (dojo_test.engagement_id = dojo_engagement.id)
INNER JOIN dojo_product ON (dojo_engagement.product_id = dojo_product.id)
INNER JOIN dojo_product_member
ON (dojo_product_member .product_id = dojo_engagement.product_id
AND dojo_product_member.role_id IN (1, 2, 3, 4, 5)
AND dojo_product_member.user_id = 542)
UNION
SELECT distinct dojo_finding.cwe
FROM dojo_finding
INNER JOIN dojo_test ON (dojo_finding.test_id = dojo_test.id)
INNER JOIN dojo_engagement ON (dojo_test.engagement_id = dojo_engagement.id)
INNER JOIN dojo_product ON (dojo_engagement.product_id = dojo_product.id)
INNER JOIN  dojo_product_type_group
ON (dojo_product_type_group.product_type_id = dojo_product.prod_type_id
AND dojo_product_type_group.role_id IN (1, 2, 3, 4, 5))
INNER JOIN dojo_dojo_group
ON (dojo_product_type_group.group_id = dojo_dojo_group .id)
INNER JOIN dojo_dojo_group_member
ON (dojo_dojo_group .id = dojo_dojo_group_member .group_id AND dojo_dojo_group_member .user_id = 542)
UNION
SELECT distinct dojo_finding.cwe
FROM dojo_finding
INNER JOIN dojo_test ON (dojo_finding.test_id = dojo_test.id)
INNER JOIN dojo_engagement ON (dojo_test.engagement_id = dojo_engagement.id)
INNER JOIN dojo_product ON (dojo_engagement.product_id = dojo_product.id)
INNER JOIN  dojo_product_group
ON (dojo_product_group.product_id = dojo_engagement.product_id
AND dojo_product_group.role_id IN (1, 2, 3, 4, 5))
INNER JOIN dojo_dojo_group
ON (dojo_product_group.group_id = dojo_dojo_group .id)
INNER JOIN dojo_dojo_group_member
ON (dojo_dojo_group .id = dojo_dojo_group_member .group_id AND dojo_dojo_group_member .user_id = 542)
WHERE dojo_finding.active
`

Now we would need to find out, how to write the Python code so that Django generates a SQL statement like this. I currently have no idea how to do this to be honest.

Hey @andresoviedo ,
We are having performance issues (specially for search/filtering operations) with much less data in our DB (250 products and 50000 findings). Could you share the configuration and the version you used for deploying Defectdojo? We want to adjust CPU and Memory to meet our requirements.

Hi @farsheedify
Version 2.8.0
Cpu/ram 4 cores/16gb

Hi @farsheedify Version 2.8.0 Cpu/ram 8 cores/32gb

Thanks Andre. Have you deployed databse on a separate VM, and a single worker for DefectDojo?