Trying to require the package "@emotion/core" without it being listed in its dependencies

Describe the bug
When using sotrybook within a yarn PnP project, we get this error:
Trying to require the package "@emotion/core" without it being listed in its dependencies
Here is how to fix this:
https://yarnpkg.com/en/docs/pnp/troubleshooting#toc-is-trying-to-require-without-it-being-listed-in-its-dependencies
Fixes for https://github.com/storybooks/storybook/issues/5919 do not fix this.
To Reproduce

Take a valid storybook project
Enable yarn pnp on the project by adding  this to package.json:

"installConfig": {
    "pnp": true
  },

storybook start

Expected behavior
Correct dependency declaration that does not create this problem
Screenshots
ERR! Error: Package "<EMAIL_ADDRESS>(via "/Users/vincent/Library/Caches/Yarn/v4/npm-<EMAIL_ADDRESS>is trying to require the package "@emotion/core" (via<EMAIL_ADDRESS>without it being listed in its dependencies (@storybook/addons, @storybook/client-logger, @storybook/components, @storybook/core-events, @storybook/router, @storybook/theming, core-js, fast-deep-equal, fuzzy-search, global, history, keycode, lodash.debounce, lodash.isequal, lodash.mergewith, lodash.pick, lodash.sortby, lodash.throttle, markdown-to-jsx, memoizerific, polished, prop-types, qs, react, react-dom, react-draggable, react-helmet-async, react-hotkeys, react-lifecycles-compat, react-modal, react-resize-detector, recompose, semver, telejson, util-deprecate, @storybook/ui)
ERR!     at makeError (/Users/vincent/Code/sterblue/.pnp.js:55:17)
ERR!     at Object.resolveToUnqualified (/Users/vincent/Code/sterblue/.pnp.js:34411:17)
ERR!     at Object.resolveRequest (/Users/vincent/Code/sterblue/.pnp.js:34482:31)
ERR!     at Function.Module._resolveFilename (/Users/vincent/Code/sterblue/.pnp.js:34664:30)
ERR!     at Function.resolve (internal/modules/cjs/helpers.js:30:19)
ERR!     at Object.<anonymous> (/Users/vincent/Library/Caches/Yarn/v4/npm-@storybook-ui-5.0.11-207f767d96e40513bb3887b428a4d9a81d027051/node_modules/@storybook/ui/paths.js:6:36)
ERR!     at Module._compile (internal/modules/cjs/loader.js:701:30)
ERR!     at Object.Module._extensions..js (internal/modules/cjs/loader.js:712:10)
ERR!     at Module.load (internal/modules/cjs/loader.js:600:32)
ERR!     at Function.Module._load (/Users/vincent/Code/sterblue/.pnp.js:34607:14)
ERR!     at Module.require (internal/modules/cjs/loader.js:637:17)
ERR!     at require (internal/modules/cjs/helpers.js:22:18)
ERR!     at Object.<anonymous> (/Users/vincent/Library/Caches/Yarn/v4/npm-@storybook-core-5.0.11-e941cf18ef62ee962607d1fb24c57b9cafc88cfd/node_modules/@storybook/core/dist/server/manager/manager-webpack.config.js:18:37)
ERR!     at Module._compile (internal/modules/cjs/loader.js:701:30)
ERR!     at Object.Module._extensions..js (internal/modules/cjs/loader.js:712:10)
ERR!     at Module.load (internal/modules/cjs/loader.js:600:32)
ERR!  { Error: Package "<EMAIL_ADDRESS>(via "/Users/vincent/Library/Caches/Yarn/v4/npm-<EMAIL_ADDRESS>is trying to require the package "@emotion/core" (via<EMAIL_ADDRESS>without it being listed in its dependencies (@storybook/addons, @storybook/client-logger, @storybook/components, @storybook/core-events, @storybook/router, @storybook/theming, core-js, fast-deep-equal, fuzzy-search, global, history, keycode, lodash.debounce, lodash.isequal, lodash.mergewith, lodash.pick, lodash.sortby, lodash.throttle, markdown-to-jsx, memoizerific, polished, prop-types, qs, react, react-dom, react-draggable, react-helmet-async, react-hotkeys, react-lifecycles-compat, react-modal, react-resize-detector, recompose, semver, telejson, util-deprecate, @storybook/ui)
ERR!     at makeError (/Users/vincent/Code/sterblue/.pnp.js:55:17)
ERR!     at Object.resolveToUnqualified (/Users/vincent/Code/sterblue/.pnp.js:34411:17)
ERR!     at Object.resolveRequest (/Users/vincent/Code/sterblue/.pnp.js:34482:31)
ERR!     at Function.Module._resolveFilename (/Users/vincent/Code/sterblue/.pnp.js:34664:30)
ERR!     at Function.resolve (internal/modules/cjs/helpers.js:30:19)
ERR!     at Object.<anonymous> (/Users/vincent/Library/Caches/Yarn/v4/npm-@storybook-ui-5.0.11-207f767d96e40513bb3887b428a4d9a81d027051/node_modules/@storybook/ui/paths.js:6:36)
ERR!     at Module._compile (internal/modules/cjs/loader.js:701:30)
ERR!     at Object.Module._extensions..js (internal/modules/cjs/loader.js:712:10)
ERR!     at Module.load (internal/modules/cjs/loader.js:600:32)
ERR!     at Function.Module._load (/Users/vincent/Code/sterblue/.pnp.js:34607:14)
ERR!     at Module.require (internal/modules/cjs/loader.js:637:17)
ERR!     at require (internal/modules/cjs/helpers.js:22:18)
ERR!     at Object.<anonymous> (/Users/vincent/Library/Caches/Yarn/v4/npm-@storybook-core-5.0.11-e941cf18ef62ee962607d1fb24c57b9cafc88cfd/node_modules/@storybook/core/dist/server/manager/manager-webpack.config.js:18:37)
ERR!     at Module._compile (internal/modules/cjs/loader.js:701:30)
ERR!     at Object.Module._extensions..js (internal/modules/cjs/loader.js:712:10)
ERR!     at Module.load (internal/modules/cjs/loader.js:600:32)
ERR!   stack:
ERR!    'Error: Package "<EMAIL_ADDRESS>(via "/Users/vincent/Library/Caches/Yarn/v4/npm-<EMAIL_ADDRESS>is trying to require the package "@emotion/core" (via<EMAIL_ADDRESS>without it being listed in its dependencies (@storybook/addons, @storybook/client-logger, @storybook/components, @storybook/core-events, @storybook/router, @storybook/theming, core-js, fast-deep-equal, fuzzy-search, global, history, keycode, lodash.debounce, lodash.isequal, lodash.mergewith, lodash.pick, lodash.sortby, lodash.throttle, markdown-to-jsx, memoizerific, polished, prop-types, qs, react, react-dom, react-draggable, react-helmet-async, react-hotkeys, react-lifecycles-compat, react-modal, react-resize-detector, recompose, semver, telejson, util-deprecate, @storybook/ui)\n    at makeError (/Users/vincent/Code/sterblue/.pnp.js:55:17)\n    at Object.resolveToUnqualified (/Users/vincent/Code/sterblue/.pnp.js:34411:17)\n    at Object.resolveRequest (/Users/vincent/Code/sterblue/.pnp.js:34482:31)\n    at Function.Module._resolveFilename (/Users/vincent/Code/sterblue/.pnp.js:34664:30)\n    at Function.resolve (internal/modules/cjs/helpers.js:30:19)\n    at Object.<anonymous> (/Users/vincent/Library/Caches/Yarn/v4/npm-@storybook-ui-5.0.11-207f767d96e40513bb3887b428a4d9a81d027051/node_modules/@storybook/ui/paths.js:6:36)\n    at Module._compile (internal/modules/cjs/loader.js:701:30)\n    at Object.Module._extensions..js (internal/modules/cjs/loader.js:712:10)\n    at Module.load (internal/modules/cjs/loader.js:600:32)\n    at Function.Module._load (/Users/vincent/Code/sterblue/.pnp.js:34607:14)\n    at Module.require (internal/modules/cjs/loader.js:637:17)\n    at require (internal/modules/cjs/helpers.js:22:18)\n    at Object.<anonymous> (/Users/vincent/Library/Caches/Yarn/v4/npm-@storybook-core-5.0.11-e941cf18ef62ee962607d1fb24c57b9cafc88cfd/node_modules/@storybook/core/dist/server/manager/manager-webpack.config.js:18:37)\n    at Module._compile (internal/modules/cjs/loader.js:701:30)\n    at Object.Module._extensions..js (internal/modules/cjs/loader.js:712:10)\n    at Module.load (internal/modules/cjs/loader.js:600:32)',
ERR!   code: 'UNDECLARED_DEPENDENCY',
ERR!   data:
ERR!    { request<EMAIL_ADDRESS>ERR!      issuer:
ERR!       '/Users/vincent/Library/Caches/Yarn/v4/npm-<EMAIL_ADDRESS>ERR!      issuerLocator: { name: '@storybook/ui', reference: '5.0.11' },
ERR!      dependencyName: '@emotion/core',
ERR!      candidates:
ERR!       [ '@storybook/addons',
ERR!         '@storybook/client-logger',
ERR!         '@storybook/components',
ERR!         '@storybook/core-events',
ERR!         '@storybook/router',
ERR!         '@storybook/theming',
ERR!         'core-js',
ERR!         'fast-deep-equal',
ERR!         'fuzzy-search',
ERR!         'global',
ERR!         'history',
ERR!         'keycode',
ERR!         'lodash.debounce',
ERR!         'lodash.isequal',
ERR!         'lodash.mergewith',
ERR!         'lodash.pick',
ERR!         'lodash.sortby',
ERR!         'lodash.throttle',
ERR!         'markdown-to-jsx',
ERR!         'memoizerific',
ERR!         'polished',
ERR!         'prop-types',
ERR!         'qs',
ERR!         'react',
ERR!         'react-dom',
ERR!         'react-draggable',
ERR!         'react-helmet-async',
ERR!         'react-hotkeys',
ERR!         'react-lifecycles-compat',
ERR!         'react-modal',
ERR!         'react-resize-detector',
ERR!         'recompose',
ERR!         'semver',
ERR!         'telejson',
ERR!         'util-deprecate',
ERR!         '@storybook/ui' ] } }

Code snippets
If applicable, add code samples to help explain your problem.
System:

OS:  MacOS
Device: Macbook Pro 2018
Framework: react
Version: 5.0.11

Additional context
@arcanis Should now about this

Here is a way to somewhat work around this (didn't get storybook to work yet though..)
It uses solution 3 listed here : https://yarnpkg.com/en/docs/pnp/troubleshooting#toc-is-trying-to-require-without-it-being-listed-in-its-dependencies
Go to top level package and then:
yarn add @storybook/channels @emotion/core @emotion/styled emotion-theming

I have this other bug afterwars btw:
https://github.com/storybooks/storybook/issues/6905
Am I the first person in the world to run storybook on a project installed with yarn pnp, or am I badly mistaken somewhere ?
@arcanis , https://yarnpkg.com/en/docs/pnp/troubleshooting#toc-is-trying-to-require-without-it-being-listed-in-its-dependencies . says I am supposed to ping you.

There's been a few reports of incompatibilities with Storybook but unfortunately those who did them didn't have the bandwidth to investigate. I did try a bit, but since I never used Storybook myself I would have to learn it first and it didn't seem straightforward 😅
I'm pretty sure the problems can be fixed with only a few PRs, and I'd be happy to lend my experience to help achieve this goal! We did the same thing with Gatsby and it really was just a few dependencies to add here and there, and the Webpack plugin to add to the configuration (like here: https://github.com/gatsbyjs/gatsby/pull/12315).

This file might be a good culprit ?
https://github.com/storybooks/storybook/blob/master/app/react/src/server/cra-config.js

I made a quick first pass. My methodology:
$> yarn create react-app sb-test && cd sb-test
$> yarn add @storybook/cli && yarn sb init
$> yarn policies set-version berry

This gives us a project with Storybook using Yarn v2 (Yarn v2 is where most of the development occurs nowadays, and in particular it uses PnP by default; it's the best place to debug such issues).

I had to do the following changes to the resulting lockfile in order to get somewhere (note that except for pnp-webpack-plugin, all those dependencies should be listed regardless of whether we're operating in PnP or non-PnP mode; not listing them makes Storybook subject to hoisting issues):

storybook/core:

Adds pnp-webpack-plugin to the dependencies
Adds babel-plugin-add-react-displayname to the dependencies

storybook/ui:

Adds @emotion/core to the dependencies
Adds @emotion/styled to the dependencies
Adds @storybook/channel to the dependencies
Adds emotion-theming to the dependencies
Adds regenerator-runtime to the dependencies

Additionally, I had to "unplug" Storybook in my package.json, as it tries to create new directories inside its own directory at runtime (Yarn 2 keeps by default all packages within their own archives, which prevents them from modifying their sources. Unplugging a package means that it will be unpacked within their own directory, which we don't recommend as it breaks zero-installs):
{
  "dependenciesMeta": {
    "@storybook/core": {
      "unplugged": true
    }
  }
}

The pnp-webpack-plugin now has to be injected inside the configuration. I found a few places where this needs to be done:

https://github.com/storybooks/storybook/blob/next/lib/core/src/server/preview/base-webpack.config.js
https://github.com/storybooks/storybook/blob/next/lib/core/src/server/preview/iframe-webpack.config.js
https://github.com/storybooks/storybook/blob/next/lib/core/src/server/manager/manager-webpack.config.js

Again, I don't know much about Storybook so I find it curious that there are so many different configuration files - maybe I'm missing something? In particular, the base-webpack file doesn't seem to be reused by iframe-webpack and manager-webpack, so I don't know what uses it. Regardless, they need to be modified to contain a code similar to this pseudocode:
const PnpWebpackPlugin = require('pnp-webpack-plugin');

module.exports = {
  resolve: {
    plugins: [
      PnpWebpackPlugin,
    ],
  },
};

The babel-loader helper also has to be modified to use require.resolve('babel-loader') instead of just babel-loader.

After following all those steps I ended up on something that builds, but running it I get a runtime error:
vendors~main.204baa2a64d34d32b96d.bundle.js:22447 Uncaught TypeError: Cannot assign to read only property 'exports' of object '#<Object>'
    at Module.<anonymous> (vendors~main.204baa2a64d34d32b96d.bundle.js:22447)
    at Module../.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_object-keys.js (vendors~main.204baa2a64d34d32b96d.bundle.js:22450)
    at __webpack_require__ (runtime~main.e27e72d77edfc378d751.bundle.js:80)
    at Object../.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_object-dps.js (vendors~main.204baa2a64d34d32b96d.bundle.js:22260)
    at __webpack_require__ (runtime~main.e27e72d77edfc378d751.bundle.js:80)
    at Object../.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_object-create.js (vendors~main.204baa2a64d34d32b96d.bundle.js:22164)
    at __webpack_require__ (runtime~main.e27e72d77edfc378d751.bundle.js:80)
    at Object../.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_iter-create.js (vendors~main.204baa2a64d34d32b96d.bundle.js:21648)
    at __webpack_require__ (runtime~main.e27e72d77edfc378d751.bundle.js:80)
    at Module.<anonymous> (vendors~main.204baa2a64d34d32b96d.bundle.js:21694)

The faulty code is the module.exports assignment in the following snippet:
/***/ "./.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_object-keys.js":
/*!*********************************************************************************************************************************************************!*\
  !*** ./.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_object-keys.js ***!
  \*********************************************************************************************************************************************************/
/*! no exports provided */
/***/ (function(module, __webpack_exports__, __webpack_require__) {

"use strict";
__webpack_require__.r(__webpack_exports__);
/* WEBPACK VAR INJECTION */(function(module) {/* harmony import */ var core_js_modules_web_dom_iterable__WEBPACK_IMPORTED_MODULE_0__ = __webpack_require__(/*! core-js/modules/web.dom.iterable */ "./.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/web.dom.iterable.js");
/* harmony import */ var core_js_modules_web_dom_iterable__WEBPACK_IMPORTED_MODULE_0___default = /*#__PURE__*/__webpack_require__.n(core_js_modules_web_dom_iterable__WEBPACK_IMPORTED_MODULE_0__);

// <IP_ADDRESS> / <IP_ADDRESS> Object.keys(O)
var $keys = __webpack_require__(/*! ./_object-keys-internal */ "./.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_object-keys-internal.js");

var enumBugKeys = __webpack_require__(/*! ./_enum-bug-keys */ "./.yarn/cache/core-js-npm-2.6.9-f034530cf2064b0812b01d6590542b0dbd4006bc7611ea0ab1bc7cfcc2d17c7f.zip/node_modules/core-js/modules/_enum-bug-keys.js");

module.exports = Object.keys || function keys(O) {
  return $keys(O, enumBugKeys);
};
/* WEBPACK VAR INJECTION */}.call(this, __webpack_require__(/*! ./../../../../webpack-npm-4.32.2-21c8ff8dcc2c4971b61859e9e22de16292dec8acb6d592a55e798a87b574f514.zip/node_modules/webpack/buildin/harmony-module.js */ "./.yarn/cache/webpack-npm-4.32.2-21c8ff8dcc2c4971b61859e9e22de16292dec8acb6d592a55e798a87b574f514.zip/node_modules/webpack/buildin/harmony-module.js")(module)))

/***/ }),

I'm not exactly sure what causes this; more investigation will be needed once the first issues I've reported have been fixed!

@crubier You should be able to override the webpack configuration without modifying those files using "full control mode": https://storybook.js.org/docs/configurations/custom-webpack-config/

@shilman I agree with this but I have been trying this for a long time now, to now avail. I always get the problem seen in #6905

@arcanis great digging! In my limited understanding of storybook, it has "2 webpacks" one for the storybook UI and wrapper stuff, where the actual server is ran, which they call manager, and one do be configured by the user, i guess the 'iframe'.
@shilman  I believe "full control mode" only allows to configure the iframe-webpack. I'm also trying to use sotrybook with yarn 2 and pnp, so you are not alone.

@shilman Here is an example of a webpack override that could be expected to work but does not:
const PnpWebpackPlugin = require(`pnp-webpack-plugin`);

// Export a function. Accept the base config as the only param.
module.exports = async ({ config, mode }) => {
  // `mode` has a value of 'DEVELOPMENT' or 'PRODUCTION'
  // You can change the configuration based on that.
  // 'PRODUCTION' is used when building the static version of storybook.

  // Make whatever fine-grained changes you need
  console.log("config Pre");
  console.log(config);
  const newConfig = {
    ...(config || {}),
    module: {
      ...((config || {}).module || {}),
      rules: [
        ...(((config || {}).module || {}).rules || []),
        {
          test: /\.tsx?$/,
          loader: require.resolve("babel-loader")
        }
      ]
    },
    resolve: {
      ...((config || {}).resolve || {}),
      plugins: [
        ...(((config || {}).resolve || {}).plugins || []),
        PnpWebpackPlugin
      ]
    },
    resolveLoader: {
      ...((config || {}).resolveLoader || {}),
      plugins: [
        ...(((config || {}).resolveLoader || {}).plugins || []),
        PnpWebpackPlugin.moduleLoader(module)
      ]
    },
    optimization: {
      ...((config || {}).optimization || {}),
      minimizer: undefined
    }
  };

  console.log("config Post");
  console.log(newConfig);

  // Return the altered config
  return newConfig;
};

@shilman I think the "full control mode" allows to customize what @marco-silva0000 calls "the one do be configured by the user, i guess the 'iframe'."
But is there a way to configure the othe rone, what @marco-silva0000 calls "the one for the storybook UI and wrapper stuff, where the actual server is ran" ?
This is the one causing the bug now for me.

@crubier you have more info about that on #4995 It's a pretty long conversation, and honestly I'm not sure about the state of te problem, but maybe you can figure it out, if not I'm sure @shilman can help us out.

@marco-silva0000 Thank you, I think this is going in the right direction, even though it . does not work yet

@crubier @marco-silva0000 Yeah that #4995 is exactly right. I've merged the presets documentation in #5333 and you can see the relevant docs here:
https://next--storybooks.netlify.com/presets/writing-presets/#advanced-configuration
Hopefully this makes sense. If not, hop on Discord and I can help you get going and update the documentation to make it more clear.

OMG Ok This works :tada:
It was painful, but it works and the solution is relatively simple in the end, thanks to presets.
The solution is a combination of @arcanis answers + this storybook preset
//pnp-ts-preset.js
const PnpWebpackPlugin = require(require.resolve("pnp-webpack-plugin"));

function webpack(webpackConfig = {}, options = {}) {
  const { module = {}, resolve = {}, resolveLoader = {} } = webpackConfig;
  const { tsLoaderOptions, tsDocgenLoaderOptions, include } = options;

  return {
    ...webpackConfig,
    module: {
      ...module,
      rules: [
        ...(module.rules || []),
        {
          test: /\.tsx?$/,
          use: [
            {
              loader: require.resolve("ts-loader"),
              options: PnpWebpackPlugin.tsLoaderOptions({
                "compilerOptions": {
                  "jsx": "react",
                  "skipLibCheck": true,
                  "esModuleInterop": true,
                  "allowSyntheticDefaultImports": true,
                  "strict": false
                }
              })
            },
            {
              loader: require.resolve("react-docgen-typescript-loader"),
              options: tsDocgenLoaderOptions
            }
          ],
          include
        }
      ]
    },
    resolve: {
      ...resolve,
      extensions: [...(resolve.extensions || []), ".ts", ".tsx"],
      plugins: [...(resolve.plugins || []), PnpWebpackPlugin]
    },
    resolveLoader: {
      ...resolveLoader,
      plugins: [
        ...(resolveLoader.plugins || []),
        PnpWebpackPlugin.moduleLoader("@storybook/react")
      ]
    }
  };
}

function managerWebpack(webpackConfig = {}, options = {}) {
  const { module = {}, resolve = {}, resolveLoader = {} } = webpackConfig;
  const { tsLoaderOptions, tsDocgenLoaderOptions, include } = options;

  return {
    ...webpackConfig,
    module: {
      ...module,
      rules: [
        ...(module.rules || [])
      ]
    },
    resolve: {
      ...resolve,
      extensions: [...(resolve.extensions || []), ".ts", ".tsx"],
      plugins: [...(resolve.plugins || []), PnpWebpackPlugin]
    },
    resolveLoader: {
      ...resolveLoader,
      plugins: [
        ...(resolveLoader.plugins || []),
        // PnpWebpackPlugin.moduleLoader(module)
        PnpWebpackPlugin.moduleLoader("@storybook/react")
      ]
    }
  };
}

module.exports = { webpack, managerWebpack };

// presets.js
const path = require("path");

module.exports = [path.resolve("./.storybook/pnp-ts-preset")];

I will probably make a PR on Friday.
Thanks all !

PR for adding a preset for Pnp here:
https://github.com/storybookjs/presets/pull/8

Second PR following @arcanis recommandations above:
https://github.com/storybookjs/storybook/pull/6922

Merged! Marked it as a patch, so should be part of next 5.1.x release

Ermahgerd!! I just released https://github.com/storybookjs/storybook/releases/tag/v5.2.0-alpha.29 containing PR #6922 that references this issue. Upgrade today to try it out!
You can find this prerelease on the @debug NPM tag.
Closing this issue. Please re-open if you think there's still more to do.

Good golly!! I just released https://github.com/storybookjs/storybook/releases/tag/v5.2.0-alpha.29 containing PR #6922 that references this issue. Upgrade today to try it out!
You can find this prerelease on the @debug NPM tag.
Closing this issue. Please re-open if you think there's still more to do.

Ermahgerd!! I just released https://github.com/storybookjs/storybook/releases/tag/v5.1.9 containing PR #6922 that references this issue. Upgrade today to try it out!


Function named __main_argc_argv

I know, I know, unlikely, but I was running xcc on some test cases and got a compile error for this:
int __main_argc_argv() {
  return 1;
}
int main() {
  return 0;
}

Error:
src/cc/frontend/var.c:54: define_global: Assertion `storage & VS_EXTERN` failed

I confirmed gcc and clang can compile this.

@jeff-hykin
The reason is that wcc renames the main function to __main_argc_argv, which causes a definition conflict.
At least it is bad that assert is generated, so I modified it to raise an error.

Why does it need to rename main?

The reason for renaming the main function is to make the wcc output compilable and linkable in Emscripten as well.
$ ./wcc -c examples/hello.c && emcc -o hello.wasm hello.o && ./tool/runwasi hello.wasm
Hello, world!

Oh. So is the rename specific to targeting webassembly?
I'm guessing emscripten expects __main_argc_argv to be exported for main functions that take arguments (e.g. int main(int argc, char* argv)) and then uses something else like __main for int main().

I'm going to close this issue.


refactor: add unique app id for eventhub

:tada: This PR is included in version 1.0.2 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


"[redacted]'s answer changed from [redacted] to [redacted]."

Was announced in #puzzle-announcements. The two answers were the same.
(Redacting since hunt is still ongoing...almost posted the actual answer)

This one is kind of mysterious, it happened multiple times during hunt. We do have a check that should prevent this from happening and I haven't figured out how to repro it locally. Noticed that the API method here was missing a transaction block, which could be related, but not totally sure.

This one is kind of mysterious, it happened multiple times during hunt. We do have a check that should prevent this from happening and I haven't figured out how to repro it locally. Noticed that the API method here was missing a transaction block, which could be related, but not totally sure.

I should have checked when this was added... it was merged in #457 after mystery hunt. Closing.


Remove reference to IRC channel (no longer exists)

If Apache Commons has an IRC presence somewhere, please disregard this PR and update the reference instead.  I confirmed that the current reference leads to an empty IRC channel.

@sebbASF Do you know?

Check, the plugin that generates the readme needs to be updated.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (470f048) 0.49% compared to head (ed1cc06) 0.49%.
Report is 7 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff            @@
##             master    #123   +/-   ##
========================================
  Coverage      0.49%   0.49%
  Complexity        1       1
========================================
  Files             5       5
  Lines           406     406
  Branches         66      66
========================================
  Hits              2       2
  Misses          404     404

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Updated to commons-parent to pick up new templates with the IRC reference removed and regenerated the generated files.


Add method .wrap(options, promise) to $ionicLoading.

Add method to wrap a promise inside a loading indicator (c.f. #4182).

Do you have an example of how this would work? Also, could you provide a test for this?

Here is an example:
$ionicLoading.wrap({ template: "Doing stuff asynchronously..." }, doStuffAsync());

instead of
$ionicLoading.show({ template: "Doing stuff asynchronously..." });
doStuffAsync().finally(function() {
  $ionicLoading.hide();
});

I will provide some tests, and also make the .wrap method return the wrapped promise so that the following is made possible:
$ionicLoading.wrap({ template: "Doing stuff asynchronously..." }, doStuffAsync())
  .then(function() {
    doSomeOtherStuff();
  });

Hmm after giving it some thoughts, I am not too sure what to test for here. Any suggestion?

I like the idea, but I don't think it's really necessary. Thanks anyways


Change library version to 3.9-SNAPSHOT - API const fix and some cleanup

Changed library version to 3.9-SNAPSHOT. Also made some method params as const reference to allow for stack allocated parameter usage.
Also a correction for an incorrect namespace forward declaration.

Test FAILed.

verify

Test PASSed.


When viewing users in a group, clicking next page brings you to list of all users

Issue Summary
When clicking to view users within a group. The pagination brings you to the list of ALL users, not the users within a specific group.
Steps to Reproduce

Go to edit a group within wagtail
Click "View users in this group" in the top right.
If you have enough users in this group to necessitate pagination, click "next"

You'll now be viewing all users, not just the users within that group.
Technical details

Python version: 3.7.7
Django version: 3.1.6.
Wagtail version: 2.12

I believe it's due to this line:
https://github.com/wagtail/wagtail/blob/main/wagtail/users/templates/wagtailusers/users/results.html#L17
Where it's passing in the link url as wagtailusers_users:index - I think this needs to be a different named url, however I could not find the named url that matches the pattern: wagtail/groups/<group id here>/users/

Hi ! I'd like to work on this.

I was able to reproduce the bug. The above linked PR fixes it.

Fixed in #6880


Added alternative Keys for Exclamation Mark and Question Mark

Hello,
I have been testing this keyboard for spanish usage, and have discovered that the upside down exclamation and question mark are missing, so I have added them.

@Johannes-bichler thank you for your contribution! Could you please rewrite the commit message in a better way; like:
SymbolLayout: add alternative keys for Spanish language

Added upside-down exclamation and question mark alternative keys for Spanish usage.

Thank you! The commit message was fixed.

LGTM


bzcleaner: retry on bugzilla.put failures

Coverage decreased (-0.03%) to 26.217% when pulling 6e50961c4e35498ac12b295dd74eabb8cd456337 on calixteman:retry_on_bz_failures into 0f24ce1edc3de1aa7819d5e554357f1816ba7152 on mozilla:master.


Added Word shuffle game

PR Description 📜
Fixes #4406

Mark the task you have completed ✅

[ ] I follow CONTRIBUTING GUIDELINE & CODE OF CONDUCT of this project.
[x] I have performed a self-review of my own code or work.
[x] I have commented my code, particularly in hard-to-understand areas.
[x] My changes generates no new warnings.
[x] I have followed proper naming convention showed in CONTRIBUTING GUIDELINE
[x] I have added screenshot for website preview in assets/images
[x] I have added entries for my game in main README.md
[x] I have added README.md in my folder
[x] I have added working video of the game in README.md (optional)
[x] I have specified the respective issue number for which I have requested the new game.

Add your screenshots(Optional) 📸

Thank you soo much for contributing to our repository 💗

Thank you @thevijayshankersharma ,for creating the PR and contributing to our GameZone 💗
Review team will review the PR and will reach out to you soon! 😇
Make sure that you have marked all the tasks that you are done with ✅.
Thank you for your patience! 😀

@ishita-43 Is it okay now ??

@ishita-43 @kunjgit All things is correct now. You can merge it.

Thank you  @thevijayshankersharma , for your valuable time and contribution in our GameZone 💗.
It’s our GameZone, so Let’s build this GameZone altogether !!🤝
Hoping to see you soon with another PR again 😇
Wishing you all the best for your journey into Open Source🚀


Pulse view title on click if view is already open

If a View that is already open is selected in the sidebar, the View's title area should pulse with a highlight to temporarily bring attention to the View panel. Right now, there's no feedback for the user in this situation so it looks like the open action failed.
Related: #271

Related: #311


[tekton]: build source image, hermetic build

To address some security failures

/override ci/prow/e2e-aws-operator


Compilation Error v2.0.3

I'm getting a compilation error on version 2.0.3. Here is my code snippet:
import { TwoButtonPresetBuilder } from 'angular2-modal/plugins/bootstrap';
import { Modal } from 'angular2-modal';

...

export function confirm(modal: Modal): TwoButtonPresetBuilder {
  return modal.confirm().size('lg')
      .titleHtml(`

...

Property 'size' does not exist on type 'ModalControllingContextBuilder<any>'.

i have a same problem


Trinity logs should automatically rotate across runs

What is wrong?
trinity{,-beacon} saves logs across runs but the default is to simply append to the same file. It is convenient for diagnosing particular issues if the logs are unique across runs of the client.
How can it be fixed
Log rotation per instantiation of the client.

YES!

I want to take this one!


Edited the section "Supporting the Development of Django" of the readme file

I added more ways to support django

making a donation >> https://www.djangoproject.com/fundraising/
buying merchandise >> https://django.threadless.com/
github sponsoring >> https://github.com/sponsors/django
companies donation

@0proboy0 Thanks for this patch, however, all these ways are already described at the top of the fundraising page. I don't think it's worth copying them to the README.


Write a JavaScript program to find lcm of two numbers

Description
Write a JavaScript program to find lcm of two numbers
LCM (Least Common Multiple) of two numbers is the smallest number which can be divided by both numbers. For example, the LCM of 15 and 20 is 60 and LCM of 10 and 15 is 30.
Input  : 12 18
Output : 36

How to contribute

Save the solution in FindLcmOfTwoNumbers.js file
Add FindLcmOfTwoNumbers.js file in find-lcm-of-two-numbers folder

!assign


Create "List Requested Accounts" page for admins

Please do work for this task in a branch called issue-XXX.
This ticket is finished when:
-admins can create multiple user accounts, at a time. i.e. a checklist or a button that will auto create an account for an admin.
-admin can view a list of all accounts that need to be created

Email first name last name


Please confirm these before moving forward

[X] I have searched for my issue and not found a work-in-progress/duplicate/resolved issue.
[X] I have not been informed if the issue is resolved in a preview version of the winget client.

Category of the issue
Other
Brief description of your issue
The PR #90037 fails due to an installation error during the validation. The log of the validation pipeline is empty.
The result of the validation with the WinGet client is:
PS C:\repos> winget install -m C:\repos\winget-pkgs\manifests\m\maurizuki\O2\2.2.7
Found O2 [maurizuki.O2] Version 2.2.7
This application is licensed to you by its owner.
Microsoft is not responsible for, nor does it grant any licenses to, third-party packages.
Downloading https://github.com/maurizuki/O2/releases/download/v2.2.7/O2-2.2.7-setup.exe
  ██████████████████████████████  3.63 MB / 3.63 MB
Successfully verified installer hash
Starting package install...
Successfully installed

The installer is not signed, I had to confirm UAC prompt manually.
At the end of the setup process, the installed app runs and the installer closes.
Steps to reproduce
Run checks in PR #90037
Actual behavior
Installation validation failed.
Expected behavior
Installation validation succeeded.
Environment
Windows Package Manager v1.3.2691
Windows: Windows.Desktop v10.0.22621.819
System Architecture: X64
Package: Microsoft.DesktopAppInstaller v1.18.2691.0

Screenshots and Logs
No response

This is because it is failing the security check -
2022-11-29 13:38:32.930 [FAIL] Installer failed security check. Url: https://github.com/maurizuki/O2/releases/download/v2.2.7/O2-2.2.7-setup.exe Result: 0x80004005

I see that a second run resolved the problem. Thanks!


Add breadcrumbs to the user documentation

Also updated documentation to include video players, scrollable videos and iframes

Thanks for updating the user documentation @padms :smile:
Approved.


Prerendering generate localhost related links into the html of login page

Describe the bug
Prerendering have a weird behaviour with manifest icons. Particularly when it renders /login. We can found this in the head tag :
<head>
...
<link rel="icon" href="http://localhost:8000/img/icons/android-chrome-512x512.png" sizes="512x512">
<link rel="icon" href="http://localhost:8000/img/icons/android-chrome-192x192.png" sizes="192x192">
<meta name="mobile-web-app-capable" content="yes">
<meta name="x5-page-mode" content="app">
<meta name="browsermode" content="application">
<link rel="icon" href="https://bento-starter.firebaseapp.com/img/icons/android-chrome-512x512.png" sizes="512x512">
<link rel="icon" href="https://bento-starter.firebaseapp.com/img/icons/android-chrome-192x192.png" sizes="192x192">
<meta name="mobile-web-app-capable" content="yes">
<meta name="x5-page-mode" content="app">
<meta name="browsermode" content="application">
...
</head>

To Reproduce
Steps to reproduce the behavior:

Go to https://bento-starter.firebaseapp.com/login/
Look a the generated head tag

Expected behavior
The html code should look like this :
<head>
...
<link rel="icon" href="https://bento-starter.firebaseapp.com/img/icons/android-chrome-512x512.png" sizes="512x512">
<link rel="icon" href="https://bento-starter.firebaseapp.com/img/icons/android-chrome-192x192.png" sizes="192x192">
<meta name="mobile-web-app-capable" content="yes">
<meta name="x5-page-mode" content="app">
<meta name="browsermode" content="application">
...
</head>

Desktop (please complete the following information):

OS: Linux Ubuntu 18.04
Browser Chrome
Version 73

Additional context
This is probably related to the spa prerendering plugin because when I generate prod build with yarn build command I can see the wrong html template in dist/login/index.html file.

It only happens when you navigate directly in /login, if you start at root then navigate I can't reproduce.
Maybe vue-head might be messing with it too ?

Yes, I suspect either a wrong behaviour from vue-head or from pwa-plugin. What makes me to think that pwa-plugin does something wrong is that all
these headers are generated with it based from what is written in manifest.json.
These headers should be generated with relative path.
I am not sure at all, but I don't have the time right now to dig into it.


ASCompletion explicit scope - broken

ASCompletion: Generate explicit scope is set to True.
Using "Promote to class member" on button, result is:
button = new Button();
instead of this.button
Using "Generate Event handler" code generator, result is
private function onAddedToStage(e:Event):void {
removeEventListener(Event.ADDED_TO_STAGE, onAddedToStage);
Expected this.removeEventListener(Event.ADDED_TO_STAGE, onAddedToStage);
http://www.flashdevelop.org/community/viewtopic.php?f=6&t=12180

WIP https://github.com/SlavaRa/flashdevelop/tree/feature/678


Actually fix entity id this time

Added a test case for it. One day I'll pull in the exhaustive schema test package.

Oooooooo, is there an exhaustive schema test package? I've been gradually building up test cases as part of the codegen rewrite, but it would be nice if there was a pre-existing test package I could lean on as well.

Yes - it was released in the 13.7 release, so once we are updated to that we can grab it (although we could probably explicitly pull that version for that package as a workaround if we really wanted to)


Support http2

reqwest already supports this but needs the feature native-tls-alpn which may not work on older operating systems (>3 years old?).
Another way is to use the rust tls backend instead of the system one with the rustls feature.
The best way to do this is probably to  enable native-tls-alpn by default and have features for the other options if the user needs them.
┆Issue is synchronized with this Jira Uncategorised by Unito

The best way to do this is probably to enable native-tls-alpn by default and have features for the other options if the user needs them.

This sounds like a good approach to me.


SMPlayer 20.6.0 / Fosshub

I tried to update SMPlayer from 20.4.2 to 20.6.0, but the old download-Url was https://wingetrepo.blob.core.windows.net/smplayer/smplayer-20.4.2-x64.exe (who is allowed to upload to this place?)
So I wanted to use the official URL (FOSSHUB) but they do not allow automated downloads (https://www.fosshub.com/tos.html).
I couldn't find guidelines in your repo for such a situation - are only MS-employees able to create a download URL for an updated package of SMPlayer?

I'm not sure who created that blob location. @lavinir submitted the PR for 20.4.2.

I'm not sure who created that blob location. @lavinir submitted the PR for 20.4.2.

Yeah I hit that issue with no automated deployments available for SMPlayer as well. I ended up creating that blob storage with the hope it would be replaced once an official automated source was available..
It's probably not sustainable to manually update this going forward, might be better to take it down.

I am still missing some guidelines how to handle such a situation in general. Does / will Microsoft provide a place where WinGet package contributors can re-upload software that is hosted on services that forbid automated downloads? Or is the message: such software simply cannot be used with WinGet.

I am still missing some guidelines how to handle such a situation in general. Does / will Microsoft provide a place where WinGet package contributors can re-upload software that is hosted on services that forbid automated downloads? Or is the message: such software simply cannot be used with WinGet.

Why is that msftbot claiming that author-feedback is needed, when I just gave the feedback, that the winget-team should provide some guidelines for this case?

Why is that msftbot claiming that author-feedback is needed, when I just gave the feedback, that the winget-team should provide some guidelines for this case?

Well, if nobody else cares, I give up and let this annoying bot close the issue.... But mark my words, this issue will sooner or later come back to haunt you ;-}

Well, if nobody else cares, I give up and let this annoying bot close the issue.... But mark my words, this issue will sooner or later come back to haunt you ;-}

The message from the bot wasn't correct. The issue will not be auto closed unless it has the "Needs-author-feedback" and hasn't had any activity for 7 days after the "Status: no recent activity" label has been added. This will not be auto closed based on the current bot rules.
We don't provide a location to host binaries for installers. There are currently no plans to provide one. Some publishers do not allow other distribution sources.

Maybe Archive.org is a good place to store them? Everyone should be happy :smiley:
There is such thing named "Topics" and "Collections", you can search by Topic and Collection, add items to collection etc. They scan for viruses every file submitted.
For security reasons every package which have non-official installer link should be checked if checksums are valid (official download and f.e. archive.org download match) - while reviewing PRs
It's only suggestion @denelon, what do you think?

I've not heard of archive.org before. I'll look into it.

@denelon SMPlayer is now in the repository. This issue can also be closed.


Add devcontainer

This allows a github codespaces setup for building Sonata software.
For now it points to a container that's under my user, the lowRISC org is setup such that I cannot just publish a public container image. I think if we setup some automated build and publish from this repository we can get the container under the lowrisc namespace on ghcr.io but this current setup will do the job for now.
To check out the codespace go to my branch here: https://github.com/GregAC/sonata-software/tree/devcontainer click on 'Code' and choose the 'Codespaces' tab. You should see a green 'Create codespace on devcontainer' click this and it'll setup a codespce.
It'll take a few minutes to create, you will eventually see a vscode UI. In the bottom panel (which has the terminal) you'll see a + icon in the top right of the panel click this and you should see a new terminal open that give the prompt 'Sonata /workspaces/sonata-software>' this is a nix devshell. This has the toolchain all setup so should be able to cd into '/workspace/sonata-system' then build the software following the docs: https://github.com/lowRISC/sonata-system/tree/main/sw/cheri

Oh if you give this a try I'd recommend deleting the codespace once you're done as your limited in number of free compute hours you get per month.

the lowRISC org is setup such that I cannot just publish a public container image

I think GitHub actions probably can publish container image?

Thanks for the review @nbdd0121 I've addressed some of your comments, the others (single user nix setup and writing the trusted-settings.json file) I'd prefer to leave for now if that's ok. This will work for now and it's important we get it merged sooner rather than later.


TC-DA-1.3- updates to be made to the chip-cert tool to run test case

Need to add log statements in the reference app to validate the NONCE

Cert Blocker Review: Assigning to @franck-apple to follow up here. This needs more information.

This is already logged in the app logs. See Examples Below:
Interactive Commands to :
./out/host/chip-tool interactive start
pairing code-paseonly 1234 MT:-24J0YXE00KA0648G00
generalcommissioning arm-fail-safe<PHONE_NUMBER>53472 1234 0
generalcommissioning set-regulatory-config 0 'us'<PHONE_NUMBER>72 1234 0
operationalcredentials certificate-chain-request 1 1234 0
Cmd + Accessory Log:
operationalcredentials attestation-request hex:955D0A79044D301B28D015D3007D852DDC8748D57DA8682A6BD8276478A9B60F 1234 0
[1654541323.897627][18211:18211] CHIP:DMG: 			CommandData =
[1654541323.897708][18211:18211] CHIP:DMG: 			{
[1654541323.897785][18211:18211] CHIP:DMG: 				0x0 = [
[1654541323.897892][18211:18211] CHIP:DMG: 					0x95, 0x5d, 0xa, 0x79, 0x4, 0x4d, 0x30, 0x1b, 0x28, 0xd0, 0x15, 0xd3, 0x0, 0x7d, 0x85, 0x2d, 0xdc, 0x87, 0x48, 0xd5, 0x7d, 0xa8, 0x68, 0x2a, 0x6b, 0xd8, 0x27, 0x64, 0x78, 0xa9, 0xb6, 0xf,
[1654541323.897981][18211:18211] CHIP:DMG: 			]

Cmd + Accessory Log:
operationalcredentials csrrequest hex:2F5E32456CEE7C66E676871D27A5CBD5FBEEB178E620ECBFBCB579109980E97D 1234 0
[1654541330.621702][18211:18211] CHIP:DMG: 			CommandData =
[1654541330.621783][18211:18211] CHIP:DMG: 			{
[1654541330.621860][18211:18211] CHIP:DMG: 				0x0 = [
[1654541330.621968][18211:18211] CHIP:DMG: 					0x2f, 0x5e, 0x32, 0x45, 0x6c, 0xee, 0x7c, 0x66, 0xe6, 0x76, 0x87, 0x1d, 0x27, 0xa5, 0xcb, 0xd5, 0xfb, 0xee, 0xb1, 0x78, 0xe6, 0x20, 0xec, 0xbf, 0xbc, 0xb5, 0x79, 0x10, 0x99, 0x80, 0xe9, 0x7d,
[1654541330.622055][18211:18211] CHIP:DMG: 			]

And with PR you will get the following log:
Attestation Nonce (32) = 955D0A79044D301B28D015D3007D852DDC8748D57DA8682A6BD8276478A9B60F

@sumaky  The Attestation None and the CSR Nonce can be obtained with the following command:
echo hex:$(hexdump -vn32 -e'4/4 "%08X" ' /dev/urandom)
This can be done twice for each command.

I would assume fixed, however this bug may need to be open to make sure test plans mention what portion of the log to use to validate the nonce (the Attestation Nonce line)

@andy31415 Test plan a in a way generic. I am not sure if we could have specifics of logs in test plans. We will for sure update the Verification Sheet with the commands used.

We have verified this issue. We are able to see the nonce. Thanks.


Improve single chunk array handling in svd

The current SVD implementation has very unintuitive performance characteristics for small arrays:
import dask.array as da
# Create short-fat (small) single-chunk array
x = da.random.random((100, 100000), chunks=(-1, -1))
x.nbytes # 80000000 = 80MB

# Despite x being 80MB, this uses ~80 **GB** of RAM and
# I have no idea how long it would take to run (at least more than 5 minutes)
da.linalg.svd(x)[0].mean().compute()

# This on the other hand runs almost instantly and barely uses any memory
da.linalg.svd(x.T)[2].T.mean().compute() # the U array is V.T when given x.T

With https://github.com/dask/dask/pull/6591 in place, it would make sense to identify single chunk arrays and transpose them first to avoid this.  That still wouldn't stop a user from providing an array with weird chunking, but I think a special case for single-chunk arrays is appropriate.

That is bizarre.

With #6591 in place, it would make sense to identify single chunk arrays and transpose them first to avoid this.

+1 from me

That still wouldn't stop a user from providing an array with weird chunking, but I think a special case for single-chunk arrays is appropriate.

More generally, I think that there is a tension between doing what the user tells us, and making some decisions for them behind the scenes.  Historically we've chosen to do what the user tells us, even if it's suboptimal, just to avoid magical behavior.
I think that we've made some decisions over the last couple of years that reverse this policy and gotten no push-back.  Personally I'd be in favor of doing a lot more automated decision making.  Transposing sounds great.  We could go even further and do automatic rechunking and such.
If you're interested in making SVD performance more robust then I'm entirely in favor.

I think that we've made some decisions over the last couple of years that reverse this policy and gotten no push-back. Personally I'd be in favor of doing a lot more automated decision making. Transposing sounds great. We could go even further and do automatic rechunking and such.

Makes sense, thanks @mrocklin.  I can't say I'd feel very confident in trying to add much more magical behavior beyond the easy single-chunk case yet, but I'll certainly try to report any useful info I find as we test tsqr more (for things other than SVD too).
On a related note, at some point I wanted to compare dask svd/tsqr to numpy/scipy svd on unchunked arrays and see if there's a big enough difference in performance that it would make sense to have some switch in our code for it.  Do you know if that's already been done before?

I would hope that numpy/scipy svd would be faster than dask array's
implementation.  For single-chunked arrays my preference would be for Dask
array to just call np.linalg.svd on the chunk
On Wed, Sep 9, 2020 at 11:18 AM Eric Czech<EMAIL_ADDRESS>wrote:

I think that we've made some decisions over the last couple of years that
reverse this policy and gotten no push-back. Personally I'd be in favor of
doing a lot more automated decision making. Transposing sounds great. We
could go even further and do automatic rechunking and such.
Makes sense, thanks @mrocklin https://github.com/mrocklin. I can't say
I'd feel very confident in trying to add much more magical behavior beyond
the easy single-chunk case yet, but I'll certainly try to report any useful
info I find as we test tsqr more (for things other than SVD too).
On a related note, at some point I wanted to compare dask svd/tsqr to
numpy/scipy svd on unchunked arrays and see if there's a big enough
difference in performance that it would make sense to have some switch in
our code for it. Do you know if that's already been done before?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/dask/dask/issues/6612#issuecomment-689733429, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AACKZTAWNFBYXV3GZCLAT63SE7BFJANCNFSM4RCTHXFQ
.

Fixed by https://github.com/dask/dask/pull/6616 (and partially https://github.com/dask/dask/pull/6623)


Android crash with V1.2.0

Describe the bug
Crashing in Android with v1.2.0
It was working perfectly with version 1.1.6, then after updating with latest version app started to crash, if I revert back to 1.1.6 it works.
Android logs
07-10 10:43:36.955 23729 23851 D SoLoader: Loaded: libreact_nativemodule_core.so
07-10 10:43:36.957 23729 23851 D SoLoader: Loaded: libturbomodulejsijni.so
07-10 10:43:36.967 23729 23851 I MMKV    : <MMKV.cpp:156::initialize> version v1.2.10, page size 4096, arch armeabi-v7a/NEON
07-10 10:43:36.967 23729 23851 I MMKV    : <MMKV.cpp:198::initializeMMKV> root dir: /data/user/0/com.appname/files/mmkv
07-10 10:43:36.967 23729 23851 I HermesVM: HermesRuntimeImpl::call: Unable to call function: stack overflow
07-10 10:43:36.968 23729 23851 F libc    : /buildbot/src/googleplex-android/ndk-release-r20/external/libcxx/../../external/libcxxabi/src/abort_message.cpp:73: abort_message: assertion "terminating with uncaught exception of type facebook::jsi::JSINativeException: HermesRuntimeImpl::call: Unable to call function: stack overflow" failed
07-10 10:43:37.422 23867 23867 D AndroidRuntime: >>>>>> START com.android.internal.os.RuntimeInit uid 10303 <<<<<<
07-10 10:43:37.436 23867 23867 W /system/bin/app_process32: Could not reserve sentinel fault page

Platform Information:
"react": "17.0.2",
"react-native": "0.64.2",
"react-native-reanimated": "^2.2.0",
"react-native-mmkv": "^1.2.0",

I confirm, v1.2.0 is crashing on android .. 1.1.6 is working
I/MMKV: <MMKV.cpp:156::initialize> version v1.2.10, page size 4096, arch x86
    <MMKV.cpp:198::initializeMMKV> root dir: /data/user/0/appbundle/files/mmkv
A/libc: Fatal signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x2 in tid 14421 (create_react_co), pid 14319

+1

Can you guys confirm that react-native-mmkv v1.2.1 fixes the issue for you?

Hey @mrousavy
I tried building v1.2.1, had cleared all cache and did fresh install, still facing the crash at the app start in Android.
07-29 12:08:22.470 21778 24959 I MMKV    : <MMKV.cpp:156::initialize> version v1.2.10, page size 4096, arch arm64-v8a
07-29 12:08:22.470 21778 24959 I MMKV    : <MMKV.cpp:167::initialize> armv8 AES instructions is supported
07-29 12:08:22.470 21778 24959 I MMKV    : <MMKV.cpp:175::initialize> armv8 CRC32 instructions is supported
07-29 12:08:22.471 21778 24959 I MMKV    : <MMKV.cpp:198::initializeMMKV> root dir: /data/user/0/com.appname/files/mmkv
.
.
07-29 12:08:24.129 25034 25034 F DEBUG   :     NOTE: Function names and BuildId information is missing for some frames due
07-29 12:08:24.129 25034 25034 F DEBUG   :     NOTE: to unreadable libraries.  I reverted the MMKV bump commits, so it has to be one of those changes:

https://github.com/mrousavy/react-native-mmkv/commit/bcac7cd61731931713d53ca44a681eda2cae564a
https://github.com/mrousavy/react-native-mmkv/commit/d9732f729c708789dde708f9e5f032b2b4953800
https://github.com/mrousavy/react-native-mmkv/commit/8b6355c222bea64d0e4f4bb97ef571c13f91fea3
https://github.com/mrousavy/react-native-mmkv/commit/c15c23089e09795a11ce25748d5321268b49635e

Reverting one of those must fix the issue 🤨

Also crashes in debug builds. Works fine with 1.1.6

We have the same problem in out project. I wanted to look into that and tried out our example app. To my surprise, it just worked. Then i copied over one of the resulting .aar files into our project and it worked, too. So it looks like there is a problem with the packaged android.aar. So maybe the problem is in the release management?
On another note: there are two android.aar files generated, android-debug.arr and android-release.arr. Looking at the filesize, is seems the debug version is in the npm package. It would be great if an release build would use the release .aar

Confirmed 1.2.0 and 1.2.1 are both a problem for dev and release versions. Locking to 1.1.6 is the only solution I've found.

Tried cleaning and rebuilding everything, does v1.2.2 work for you guys?

Tried cleaning and rebuilding everything, does v1.2.2 work for you guys?

node_modules/react-native-mmkv is missing the android folder hence the project fails to compile

Okay so sorry guys I had to publish a few version before I finally got it right. Take a look at v1.2.5 and let me know if that builds for you now.

@mrousavy it still crashes with 1.2.5. Also tried with 1.1.6 and it crashes on launch as well

I just released 1.3.0 (yay 🎉), can you test if that works for you guys? It does work fine in the Example App (which is on RN 0.65.1)

While I already spent way too much of my free time on this issue to fix the crash for random people on the internet, I spent some more time on this yesterday and finally fixed it. Check out 1.3.1. 🎉🎉🎉🎉
If you appreciate my efforts, please consider buying me a coffee for my next late-night debug session: ❤ GitHub sponsors


Support for MSVC

Waiting for C++20 class NTTP (P0732) support. Check needed.

This should work now:
static constexpr inline auto pattern = ctll::basic_fixed_string{“hello”};

bool match(std::string_view subject) {
     return ctre::re<pattern>().match(subject);
}

(in MSVC 15.8)

(I don't have MSVC and I'm fixing it at http://godbolt.ms)

Some work done in msvc branch. Blocked by MSVC ICE for same REs.

Maybe you can contact the MSVC team?
They did a lot of work for becoming compatible with Boost.Hana.
https://blogs.msdn.microsoft.com/vcblog/2018/08/30/use-the-official-boost-hana-with-msvc-2017-update-8-compiler/

I did already. https://developercommunity.visualstudio.com/content/problem/367513/internal-compiler-error-when-porting-ctre-library.html

it's working!

I ran into another compiler error with MSVC 15.8.8. I have reported it here:
https://developercommunity.visualstudio.com/content/problem/370094/fatal-error-c1001-an-internal-error-has-occurred-i-27.html

You need to have the pattern as an object with static linkage, outside the function:
#include "ctre.hpp"

static constexpr auto pattern = ctll::basic_fixed_string{ "(\\w+) (\\w+)!" };

void NotCompilerError()
{
std::wstring hello;
ctre::re<pattern>().match(hello);
}

Anyway I think MSFT people will be glad for another ICE.

Thank you. It compiles without any errors this way.


Added Bitcore BTX Support

This code adds support for BTX Bitcore : https://bitcore.cc
Github Page : https://github.com/LIMXTEC/BitCore
Include :

Bitcore icons
Bitcore Code

This Pull Request is for adding Bitcore BTX Coin to the Ledger for a normal storage.
Bitcore is a Hybrid Fork from the Bitcoin Blockchain on Block : #492820
If there a possible solution to give Bitcon Holder Access to this coins whould be a nice feature !.

Hey Guys,
Bitcore is the only fork working as a hybrid fork, this technic is the biggest replay protection itself.
The Coin have a own Genesis Block and also started with a new Blockchain on Block 0/1.
On Bitcoin Block : 492820 was a Snapshot and we load every Wallet with 50% BTX from the BTC Balance. The BTX are availible on the same Key Pair just another Network and replay protected because there are no BTC TXID exist in the BTX Blockchain and otherwhise.
Insight : https://insight.bitcore.cc/
Explorer : https://chainz.cryptoid.info/btx/
If there any infos, details or help we can provide please lets us know about it.

@btchip @fdv
If there any infos, details or help we can provide please lets us know about it.

@fdv @btchip
Please give us a respond to this topic. Bitcore is registered coin types for BIP-0044 : 0x800000a0

New Pull #72


Added my details

@anuragpatro  contribute here https://github.com/Ishaan28malik/Get-Dev-Resources


Converts to TypeScript & adds unregister function

Hello @danburzo ,
We have read your article and are impressed with your work! It's obviously taken you a lot of time to work out all the various behaviours between browsers and OS, and the level of care and detail you went through to analyse what makes a good web gesture experience is remarkable.
So we have been using your code in our application and it is working well 👏
We would be happy to help you maintain it if you are interested?
However, we realise that we may have different requirements than what you intend for this repo. The biggest one is that we want to use TypeScript, for all the various advantages it brings. Is this something you are interested in? If yes, this PR brings a standard toolchain for using it, along with what would be needed to publish the package to npm.
If you think that TypeScript does not belong in this repo, and would rather keep JavaScript, we will maintain our own version and give you credit for your original implementation.
In this PR, your code was mostly just converted to TypeScript, but I've added two minor changes:

gesture can either be an actual gesture, or hold the null value. It cannot be a boolean anymore as in your original implementation.
the okzoomer function returns a function that will unregister event listeners. This enables SPA frameworks to call it when a component is unmounted.

Looking forward to reading your feedback!

Hi Vincent,
Thank you for the kind words! I'm happy you found the article and code helpful. The latest version of the article sits on my computer waiting for the last edits, but life got in the way in the meantime :-). (Hopefully I'll be able to publish the final version some time in the near future).
The code in this repo is mostly supporting the article and in the final version it will be in a more didactic style, with copious comments, and only covering core functionality (with many adjacent concerns, such as unregistering the listeners, left as "exercises for the reader"). My intention is to provide a basis on which to develop code specific to each application, as the many knobs that can be tweaked are all over the internal functions, so I'm not seeing this as something that can necessarily be packaged and/or published to npm as-is.
For this small experiment TypeScript introduces too much additional complexity. Please feel free to reuse and build upon the code in any way you see fit (including publishing your version to npm), and let me know if the MIT license (under which I published by habit) is hindering in any way (which is not my intention). I'll also be happy to link to your implementation if you let me know where to find it!

Hi Dan,
I finally found the time to publish our version:

GH: https://github.com/skilitics/two-fingers
NPM: https://www.npmjs.com/package/@skilitics/two-fingers

We give you credit for the original code, with links to both your article and your repo.
As you were saying, this is not as much a library as a collection of code snippets / experiments that an application could choose to implement in a custom way. However, it acts well as an isolated component for us, and I guess that other users could be happy with it too, which is why we published it to npm.
We had to come up with a name too, and two-fingers made the cut, even though the current implementation handles more that that (all "wheel" events are handled too...). What do you think?

Looks very good! I'll link to the package in the final version of the article.


ValueError: There is no such driver by url...

While running
from livingpark_utils.scripts import mri_metadata
run.mri_metadata()

I get this error. Tested on MacOS Monterey.
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[3], line 1
----> 1 from livingpark_utils.scripts import mri_metadata
      2 run.mri_metadata()

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/livingpark_utils/scripts/mri_metadata.py:54
     51 missing_files = [x for x in required_files if not op.exists(os.path.join(data_dir, x))]
     53 if len(missing_files) > 0:
---> 54     ppmi = ppmi_downloader.PPMIDownloader()
     55     file_name = ppmi.download_3D_T1_info(destination_dir=data_dir, headless=False)
     56     assert(op.exists(op.join(data_dir, file_name)))

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/ppmi_downloader/ppmi_downloader.py:102, in PPMIDownloader.__init__(self, config_file, headless, tempdir, remote)
     99 self.__set_credentials(config_file)
    100 self.tempdir = tempfile.TemporaryDirectory(
    101     dir=os.path.abspath(tempdir))
--> 102 self.driver = get_driver(
    103     headless=headless, tempdir=self.tempdir.name, remote=remote)
    104 self.html = PPMINavigator(self.driver)
    106 logger.debug(self.tempdir)

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/ppmi_downloader/ppmi_downloader.py:64, in get_driver(headless, tempdir, remote)
     61     options.add_argument("--headless")
     62 if remote is None:
     63     driver = webdriver.Chrome(
---> 64         ChromeDriverManager().install(), chrome_options=options)
     65 else:
     66     if remote == 'hostname':

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/webdriver_manager/chrome.py:39, in ChromeDriverManager.install(self)
     38 def install(self) -> str:
---> 39     driver_path = self._get_driver_path(self.driver)
     40     os.chmod(driver_path, 0o755)
     41     return driver_path

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/webdriver_manager/core/manager.py:30, in DriverManager._get_driver_path(self, driver)
     27 if binary_path:
     28     return binary_path
---> 30 file = self._download_manager.download_file(driver.get_url())
     31 binary_path = self.driver_cache.save_file_to_cache(driver, file)
     32 return binary_path

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/webdriver_manager/core/download_manager.py:28, in WDMDownloadManager.download_file(self, url)
     26 def download_file(self, url: str) -> File:
     27     log(f"About to download new driver from {url}")
---> 28     response = self._http_client.get(url)
     29     return File(response)

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/webdriver_manager/core/http.py:33, in WDMHttpClient.get(self, url, **kwargs)
     31 def get(self, url, **kwargs) -> Response:
     32     resp = requests.get(url=url, verify=self._ssl_verify, stream=True, **kwargs)
---> 33     self.validate_response(resp)
     34     show_download_progress(resp)
     35     return resp

File ~/Workspace/mak-etal-2015/env/lib/python3.10/site-packages/webdriver_manager/core/http.py:16, in HttpClient.validate_response(resp)
     14 status_code = resp.status_code
     15 if status_code == 404:
---> 16     raise ValueError(f"There is no such driver by url {resp.url}")
     17 elif status_code == 401:
     18     raise ValueError(f"API Rate limit exceeded. You have to add GH_TOKEN!!!")

ValueError: There is no such driver by url https://chromedriver.storage.googleapis.com/109.0.5414.74/chromedriver_mac64_m1.zip

@niyonx, Which chrome version (browser) do you have installed on your mac?
They changed the name of the drivers for Chrome (see here).
I think selenium is trying to get the latest chrome driver, but the version detected on your OS uses the previous naming convention. That would cause an attempt to download a non-existing driver.

@mathdugre, my version is Version 109.0.5414.87 (Official Build) (arm64)
indeed, the url is not valid, with the new naming it's good.
https://chromedriver.storage.googleapis.com/109.0.5414.74/chromedriver_mac_arm64.zip|
After updating webdriver-manager-3.8.5 and my google chrome, error is now gone.
Thanks for your help, I'm able to run mri_metadata notebook now!


(PDB-1264) Ensure producer_timestamp has a value

Other features would like to rely on the value of producer_timestamp.
Newer versions of puppet populate this field, but it may be null
in upgrade scenarios. In that case, we can use the receive time
('timestamp') with no ill effects.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/884/

@mullr unit and acceptance test failures here, I think I know why. One thing the patch doesn't account for is that in our current wire format, producer timestamp can be null https://docs.puppetlabs.com/puppetdb/2.3/api/wire_format/catalog_format_v5.html same with v6 to be released in 3.0.0.

Sorry about the false start before, I must have spaced my local unit test run after adding the NOT NULL constraint. This turned into a bigger change test-wise, but I think it's for the best.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/893/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/896/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/897/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/898/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/908/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/913/

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/914/

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/918/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/919/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/923/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/924/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/927/

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/928/

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/932/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/943/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/951/

+1

@mullr needs a rebase.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/976/

@pljenkinsro retest this please

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/978/

@pljenkinsro retest this please

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/977/

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://jenkins.puppetlabs.com/job/platform_puppetdb_intn-sys_pr/979/

Transients ^^


Root of a factorizable integer

That is, to simplify something like sqrt(2 ^ 4 * e ^ 2 * k) -> 4e * sqrt(k) or (2 ^ 3 * pi^(3k) * 5 ^ 7)^(1/3) -> 2 * pi^k * 5^2 * 5^(1/3)

[ ] Do that for Power in InnerSimplify for integer as an argument
[ ] Do that for the general case in Simplify (that is, factorize the expression by Entity-long)

@TheSeems you might be interested in completing the first subtask


Update bispectra feature

Reduces some jankiness with the bispectra feature now that PyBispectra v1.2 is available (was already pinned in #355).

Many thanks for the contribution @tsbinns!


DiocesanCalendar JSON schema needs consistency

Now that we have started defining JSON schemas, and we have a number of schemas to work against, we have tried to distinguish within the schemas between properties that directly contribute to creating a Festivity object, and properties that contain supplementary information and which therefore can be placed in a Metadata object, alongside the Festivity object.
The DiocesanCalendar JSON schema needs to be brought up to par. The following properties should be moved from the Festivity object to a Metadata object:

formRowNum
sinceYear , also needs to be defined as integer, not as string with integer format!
decreeURL
decreeLangs

completed in commit de8e5486dd6af3c0bebe3c0045b030af08ea43fa


Find in Files not working

Description of your problem
What steps will reproduce the problem?

Search -> find in files
put in a word and search
fails

What is the expected output? What do you see instead?
The search
Please provide any additional information below
Traceback:
Traceback (most recent call last):
  File "/home/mplain/anaconda2/envs/rootclone2/lib/python2.7/site-packages/spyder/widgets/findinfiles.py", line 150, in run
    ok = self.find_files_in_path(self.rootpath)
  File "/home/mplain/anaconda2/envs/rootclone2/lib/python2.7/site-packages/spyder/widgets/findinfiles.py", line 217, in find_files_in_path
    for path, dirs, files in os.walk(path):
  File "/home/mplain/anaconda2/envs/rootclone2/lib/python2.7/os.py", line 296, in walk
    for x in walk(new_path, topdown, onerror, followlinks):
  File "/home/mplain/anaconda2/envs/rootclone2/lib/python2.7/os.py", line 296, in walk
    for x in walk(new_path, topdown, onerror, followlinks):
  File "/home/mplain/anaconda2/envs/rootclone2/lib/python2.7/os.py", line 296, in walk
    for x in walk(new_path, topdown, onerror, followlinks):
  File "/home/mplain/anaconda2/envs/rootclone2/lib/python2.7/os.py", line 286, in walk
    if isdir(join(top, name)):
  File "/home/mplain/anaconda2/envs/rootclone2/lib/python2.7/posixpath.py", line 73, in join
    path += '/' + b
UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 25: ordinal not in range(128)

Versions and main components

Spyder Version: 3.1.4
Python Version: 2.7.13 64 bits
Qt Version: 5.6.2
PyQt Version: PyQt5 5.6 on Linux
Operating system: Ubuntu 16.04 LTS

Dependencies
Please go to the menu entry Help > Optional Dependencies (or
Help > Dependencies), press the button Copy to clipboard
and paste the contents below:
jedi >=0.9.0     :  0.9.0 (OK)
matplotlib >=1.0 :  2.0.2 (OK)
nbconvert >=4.0  :  5.1.1 (OK)
numpy >=1.7      :  1.12.1 (OK)
pandas >=0.13.1  :  0.20.1 (OK)
pep8 >=0.6       :  1.7.0 (OK)
psutil >=0.3     :  5.2.1 (OK)
pyflakes >=0.5.0 :  1.5.0 (OK)
pygments >=2.0   :  2.2.0 (OK)
pylint >=0.25    :  1.6.5 (OK)
qtconsole >=4.2.0:  4.3.0 (OK)
rope >=0.9.4     :  0.10.5 (OK)
sphinx >=0.6.6   :  1.6.1 (OK)
sympy >=0.7.3    :  1.0 (OK)

Thanks for reporting. This was fixed in PR #4056, and it'll be part of Spyder 3.2.


Unit tests for UI SDK

Created by: @bayegan Oct 11 2021 at 13:30 CET
Last updated: Nov 19 2021 at 18:43 CET
ClickUp ID: IK-1634
To ensure that we have 90+ unit test coverage, implement unit tests for UI SDK.
Acceptance criteria:
90%+ unit test coverage

Commented by: @bayegan Oct 11 2021 at 13:30 CET
@dusan-kovacik-profiq : FYI


Migrate from setup.py to pyproject.toml

$ pip install .
...
  DEPRECATION: beets-store is being installed using the legacy 'setup.py install' method, because it does not have a 'pyproject.toml' and the 'wheel' package is not installed. pip 23.1 will enforce this behaviour change. A possible replacement is to enable the '--use-pep517' option. Discussion can be found at https://github.com/pypa/pip/issues/8559
...

Fixed in https://github.com/tschaefer/beets-store/commit/cf0d48d1663e6e0ac9889070b0768334292cce67


Authority matching for Data Ingest

submitted by MDW, assigned to @alastair

Done in the importer: https://github.com/trompamusic/ce-data-import/


Event Loop & Socket Type Multi-Support

Issue #, if available:
Description of changes:

Allow select from different event loop type
Allow select from different socket implementation
So far the CI for dispatch queue failed as dispatch queue implementation is not there yet. Refer to https://github.com/awslabs/aws-c-io/pull/661 and https://github.com/awslabs/aws-c-io/pull/662 for dispatch queue and nw_socket implementation.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

The CI Job was renamed as we introduced new compile options. I will update the required CI once before merge.
macos ->  macos(-DAWS_USE_APPLE_NETWORK_FRAMEWORK=OFF)
macos-debug ->  macos-debug (-DAWS_USE_APPLE_NETWORK_FRAMEWORK=OFF)


Rename the Weights File

In the released version 2.1, if This release targets Keras-2. These weights work with either Theano or Tensorflow (in either dim ordering), isn't it better to rename the weights file as
inception-v4_weights_tf_th_dim_ordering_tf_th_kernels-for_keras_2
inception-v4_weights_tf_th_dim_ordering_tf_th_kernels_notop-for_keras_2

to make them more "newbie-friendly" ?

Closing this out after a long hiatus from Github.
Happy to merge any pull requests if there is a desire to improve things!


Improve Decoder functionality

Work is needed on the Decoder. The 'mapping' feature should be dropped and a way should be found to prevent throwing in implementations (since OutputData doesn't have an error channel). Using 'boundary/break' might be a solution.

Update: there's no more throwing in Decoders, this should be easier to do now.


[ADN] Extract subtitles : UnicodeDecodeError: "utf-8"

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.04.09. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.04.09

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-u', 'PRIVATE', '-p', 'PRIVATE', '--cookies', '/home/asus/Téléchargements/cookies_adn.json', '--list-subs', 'http://animedigitalnetwork.fr/video/naruto/4189-episode-1-et-voici-naruto-uzumaki', '-v']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.04.09
[debug] Python version 3.5.3 (CPython) - Linux-4.9.0-6-amd64-x86_64-with-debian-9.3
[debug] exe versions: avconv 3.4.2-2, avprobe 3.4.2-2, ffmpeg 3.4.2-2, ffprobe 3.4.2-2, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {'no': 'localhost,<IP_ADDRESS>/8,::1'}
[ADN] 4189: Downloading webpage
[ADN] 4189: Downloading JSON metadata
[ADN] 4189: Downloading JSON metadata
[ADN] 4189: Downloading m3u8 information
[ADN] 4189: Downloading JSON metadata
[ADN] 4189: Downloading m3u8 information
[ADN] 4189: Downloading webpage
Traceback (most recent call last):
File "/usr/lib/python3.5/runpy.py", line 193, in _run_module_as_main
"main", mod_spec)
File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/usr/local/bin/youtube-dl/main.py", line 19, in
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 471, in main
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 461, in _real_main
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1993, in download
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 789, in extract_info
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 440, in extract
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adn.py", line 152, in _real_extract
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 2552, in extract_subtitles
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adn.py", line 58, in _get_subtitles
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc2 in position 0: invalid continuation byte

And with python version 2.7  :
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'-u', u'PRIVATE', u'-p', u'PRIVATE', u'--cookies', u'/home/asus/T\xe9l\xe9chargements/cookies_adn.json', u'--list-subs', u'http://animedigitalnetwork.fr/video/naruto/4189-episode-1-et-voici-naruto-uzumaki', u'-v']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2018.04.09
[debug] Python version 2.7.13 (CPython) - Linux-4.9.0-6-amd64-x86_64-with-debian-9.3
[debug] exe versions: avconv 3.4.2-2, avprobe 3.4.2-2, ffmpeg 3.4.2-2, ffprobe 3.4.2-2, phantomjs 2.1.1, rtmpdump 2.4
[debug] Proxy map: {'no': 'localhost,<IP_ADDRESS>/8,::1'}
[ADN] 4189: Downloading webpage
[ADN] 4189: Downloading JSON metadata
[ADN] 4189: Downloading JSON metadata
[ADN] 4189: Downloading m3u8 information
[ADN] 4189: Downloading JSON metadata
[ADN] 4189: Downloading m3u8 information
[ADN] 4189: Downloading webpage
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/usr/local/bin/youtube-dl/main.py", line 19, in
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 471, in main
File "/usr/local/bin/youtube-dl/youtube_dl/init.py", line 461, in _real_main
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1993, in download
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 789, in extract_info
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 440, in extract
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adn.py", line 152, in _real_extract
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 2552, in extract_subtitles
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/adn.py", line 58, in _get_subtitles
UnicodeDecodeError: 'ascii' codec can't decode byte 0xcd in position 2: ordinal not in range(128)

Duplicate of #12724.


net/ndproxy: Add ndproxy count

While troubleshooting I hammered sysctl net.inet6.ndproxycount in the shell relentlessly.
It is the only number that shows your configuration is correct and that something indeed happens. Having it exposed in the GUI is valuable.

I don't like this for multiple reasons: we have a generic script for sysctls, it really doesn't add enough value to be shown here and it overcomplicates the configuration page. My person feeling is to leave this out.

I'm okay with this. Thanks for your honest opinion. :)

The backend (configd action)

Ah okay thanks totally missed that. At least I learned something from this. :)
configctl system sysctl values net.inet6.ndproxycount
{"net.inet6.ndproxycount":"0"}

Yep that’s the one. 👍
if there were more precise sysctls I would agree with the suggestion though. Thanks for the proposal in any case 😊