How to recognise   as a space

Hi,
I am currently struggling with (Lk 19,1–10) and alike references. The dash is ok, but can't make the space work.
I have tried to edit
the parser file in this way:
bcv_parser.prototype.regexps.space = "(?:[\s\xa0]| )";
Thank you

So it does not work because it is not used later on...
In bcv_parser.prototype.regexps.get_books:
for Czech language I see:
{
osis: ["Gen"],
regexp: /(^|[^0-9A-Za-zªµºÀ-ÖØ-öø-ɏḀ-ỿⱠ-ⱿꜢ-ꞈꞋ-ꞎꞐ-ꞓꞠ-Ɦꟸ-ꟿ])((?:Prvn[ií][\s\xa0]*(?:kniha[\s\xa0]*Moj(?:zž|Mojzž))|1I|G(?:en(?:esis)?|n))|(?:Prvn[ií][\s\xa0]Moj(?:zž)|1I)|[1I][\s\xa0](?:kniha[\s\xa0]*Moj(?:zž|Mojzž))|[1I][\s\xa0]*Moj(?:zž))(?:(?=[\d\s\xa0.:,;\x1e\x1f&()（）[]/"'*=~-\u2013\u2014])|$)/gi
}
with spaces defined as [\s\xa0] instead of bcv_parser.prototype.regexps.space

Hi, I think \xa0 is equivalent to  , right? Could you convert the  s to the actual unicode character?


modify cache_dir permission on creation: RWX for all users

Rationale
os.makedirs makes dirs with default mode 0o777 but it will be ignored by umask
Since all users use the same tmp dirs, it's reasonal for who creates the dir to make it available for all users.
It make this package more friendly for server users with poor group management.
references:

os-offical
stackoverflow

Inspiration
Inspired by error here:
  File "/home/.../miniconda3/envs/gpt/lib/python3.10/site-packages/tiktoken/load.py", line 45, in read_file_cached
    with open(tmp_filename, "wb") as f:
PermissionError: [Errno 13] Permission denied: '/tmp/data-gym-cache/6d1cbeee0f20b3d9449abfede4726ed8212e3aee.ae9a214b-58de-415c-9e0a-024535f4f7a7.tmp'

Someone create the cache_dir and I don't have the writing permission in this cache_dir. Thought I can solve it by modifying the permission, I think it's better to be solved in the package.

Thanks, I pushed an alternate fix that will simply swallow the PermissionError in the default case. This will be released in tiktoken 0.5.2


Problem with method "with" + many via

What steps will reproduce the problem?
I want to get models with related models.
If "with" relation has operator 'via' with other relation with operator 'via' that yii2 set relation wrong.
All code:
$tableElements = EventAgendaElement::find()
            ->with(['allEventParticipant'])
            ->all();

 public function getAllEventParticipant()
    {
        return $this->hasMany(EventParticipant::class, ['Id' => 'EventParticipantId'])
            ->via('eventParticipantsInGroup');
    }

public function getEventParticipantsInGroup()
    {
        return $this->hasMany(EventParticipantInGroup::className(), ['EventAgendaParticipantGroupId' => 'Id'])
            ->via('eventAgendaParticipantGroup');
    }

public function getEventAgendaParticipantGroups()
    {
        return $this->hasMany(EventAgendaParticipantGroup::className(), ['AgendaElementId' => 'Id']);
    }

In populate method get all model EventParticipant but not set correct their to bucket.
Additional info

Q
A

Yii version
2.0.8 and 2.0.9

PHP version
5.6

Operating system
mac os

possibly a duplicate of #11898

duplicate of #5341


docs: add overrideScope, include_granted_scopes description to README.md

Added descriptions for overrideScope and include_granted_scopes parameters of useGoogleLogin in the README file.

@MomenSherif Hi MomenSherif,
I have added detailed descriptions for the parameters of the useGoogleLogin hook in the README file. I believe these additions will aid others in understanding and using the useGoogleLogin hook more easily.
Could you kindly review this PR at your earliest convenience?


ETL-3519: Add mysql utils to gobblin-utility

Tested using gobblin kafka jobs. @zliu41 @chavdar Can you review? Thanks!

@ydailinkedin there's already a DataSourceProvider in gobblin-metastore that can be used to get a DataSource instance. See if you can use that instead.

Close this one, since it somehow mixed with @zliu41 's commits


fix(interactive): fix focus tactic.

Previously it would fail if there was more than one goal.
Notes:

I haven't run the test suite. Could you add the instructions for doing that to CONTRIBUTING.md?
The test https://github.com/leanprover/lean/blob/master/tests/lean/interactive/focus.lean failed before this commit. Is the test suite executed correctly? It succeeds after this commit (though I haven't checked if it produces the right output, see first note). (I see that in the expected.out file it is supposed to raise an error)

@fpvandoorn Could you please add a test that exposes the problem?

Done


[FATAL] This web app is stopped.

The https://curse-rest-proxy.azurewebsites.net/api site that this gem uses for installing modpacks is stopped. Please bring it back.

I ran out of Azure credits for this month. The site will be back up on Nov 1st.

I feel guilty in this... I used this service a little bit... :blush:

Ha, that’s okay. It wasn’t your fault. I accidentally used the credits because I left a different project running when I shouldn’t have.

It appears that https://curse-rest-proxy.azurewebsites.net/api is still down (or is again, not sure if it was back earlier this month). What json is hosted there? If it's something easily constructed via scraping the modpack's Curse page, perhaps adding a fallback mechanism where that info could be supplied manually might be a good workaround.

if it is works under linux, i can provide you a secondary hosting for free.


chore: run go test in ci workflow

This PR runs go test in CI workflow.

Anything I should do to avoid this ?

You'd need to be an org member or something? I can look that up right after.

I think i'm a k/k member, maybe it's not enough ?

Now test fail 🤔

That seems completely unrelated? is that a flake?

Not failing locally, checking.

Ahah, i had a cluster running locally, once i deleted it test started to fail.

Ohhh, that's fishy, the tests should definitely not depend on your running environment ...

Ohhh, that's fishy, the tests should definitely not depend on your running environment ...

					openapiclient.NewLocalFiles(c.localFilesDir), // satisfy expectation users' expectation that provided local files are used
					openapiclient.NewLocalCRDFiles(c.localFilesDir),

Is this expected that we use the same dir for those two clients in the chain ?
First one is supposed to load openapi schema files and second is supposed to load CRD definitions.

Yeah, I think it's loading all the files and then decides if they are openapi or CRDs (from which we extract the openapi). That should be fine, WDYT?

My 2 cents is we could provide two flags, nothing prevents those two flags to point at the same dir.

And if I apply the fix in https://github.com/kubernetes-sigs/kubectl-validate/pull/26 test panics 🤔

Go for it :-)

Let's see if @alexzielenski can help?

Sure, from what I understand, tests are going to depend on the kubernetes version flag ? (because validation and message can vary slightly)

Anything I should do to avoid this ?

Your name shows "contributor", not "member", that's probably why. If you're a k/k member, you almost certainly can be a kubernetes-sigs member too, especially with the help you give us here.

Since the tests are making use of the RootCommand they get openapiclient.NewKubeConfig(c.kubeConfigOverrides), added automatically. We should add a way to disable that in tests to avoid running clusters being used by tests.


support multi-currency

Ability to support multi-currency
Property
currency: 'USD',
Specify the currency the Shipped offer will be displayed in

@stevenou Do the formatted values shield_fee_with_currency and green_fee_with_currency need to be called back?

off the top of my head, I feel like the callback should include both base currency values as well as "with currency" values. I imagine we already established a pattern for how to do this in the JS SDK, but I cannot remember... @catalin-invisible can you please pitch in?

I'm not sure I understand the question, to be called back where exactly?

@catalin-invisible Some data will be called back from mobile sdk to the merchant's app, I'm not sure the web.

oh, in the onChange callback where we provide isSelected and totalFee values?

yes.

I think it could help, the merchant could use the already formatted value we're providing as opposed to format it themselves.
@stevenou As a note, currently, those formatted values that come from offers request are not used anywhere in JS SDK. At the time I implemented multi-currency we did not had those values coming from the backend so I had implemented then a formatting function in frontend (based on a separate request to get currency formatting details).

so now, on JS SDK, we only provide isSelected and totalFee in the callback, (totalFee as an absolute value, with no currency information)

one issue to consider though: we're providing a total in the callback, but the formatted prices come separate: a string for sheild and a string for green - we don't have a combined formatted price

Yes, could we add green_shield_fee_with_currency in the offers as the combined price? @stevenou

unfortunately it doesn't really make sense to do that the way it's currently architected. let's just stick with only callback for totalFee without currency, for now. so far, there isn't actually any use case that even uses totalFee from the callback, let alone fee with currency.

For the mobile SDKs, only isSelected, shieldFee and greenFee are provided, but there is no totalFee, do I need to use totalFee instead of shieldFee and greenFee?

let's do whatever it is that the JS SDK does. so I believe that is isSelected and totalFee, right? @catalin-invisible

yes

okay thanks!


Allow configuring number of seed nodes per nodepool

This adds a new field to cassandra nodepools, seeds, which controls the number of seed nodes in that nodepool. This defaults to 1, and cannot be greater than the number of replicas.
Allow configuring number of seed nodes per nodepool

I'll add an e2e test for this once #258 is merged

I've changed Seeds to be an *int64, avoiding the awkward validation/defaulting for a value of 0

Should we merge this now, or wait until the actions stuff has merged and redesign this for that new structure? (targeting 0.2)


do not generate unused objects

Hi,
I do not know if it could be useful for you.
With this commit, I do not generate unused CustomFilter objects.

This change is

hi @alexppxela Thanks for submitting this PR. Even though I am the author of this plugin, the plugin was mainly wrote for my company's graphql server. This repo is actually the origin version and was not posted on postGraphile's doc site. I am curious how you found it. A better version that supports also List, NN list, list of various types is actually hosted on my company's repo  https://github.com/RoadRunnerEngineering/postgraphile-plugin-custom-filter be sure the check it out here. I'll look in this PR.


The language only supports ascii, as far as I can tell.

This may need to be worked on at some point in the future, especially if it gains traction - for now, it's fine though.

It should definitely support UTF-8 at some point. For now the compiler should ideally throw out an error if it encounters an non-ASCII character (we don't want the script to behave in weird ways just cause someone decided to put an emoji in their print statement). Should be fairly trivial by just checking the 8th bit for every character


Installation: Why verilogparser's headers are installed?

Describe the bug

First I don't think we really need verilogparser's headers to work, because there is a wrapper around it, see include/ilang/verilog-in/verilog_analysis_wrapper.h, it does not include any verilogparser header.
The paths of the verilog parser's header are strange: double include, include/include
BTW, I'd like to ask (till now I still don't understand), why renaming cpp_api.h to ila++.h, why not just put it as ila++.h, so examples need less modification if we want them to work both before and after installation (just change the path in the makefile) (Now when I plan to write an example, I had to ask myself, do I want it to work before installation or using the installation headers and which to include and get stuck right at the first line)
BTW, due to the changes of paths of include/library paths and etc. our old examples (e.g. apps/riscv-spec) would not work.
BTW, I do recommend using Ubuntu 16.04 and at least GCC 4.9 or above in Travis Cl.
The ilang headers other than the ila++.h are not installed.
BTW, the pull request check is good that it ensures compilability, but now if I want to keep developing while a pull request is pending, I cannot push to the branch for pull request, as it automatically include all future pushes before pull request is resolved. Okay, one branch for development and one branch for pull request could work. And so will come the merges here and there, if there is not enough already. My recommendation is disable it while in the period of intense development. We don't have that much time wasting on it.

To Reproduce

cmake, make, and then make install

Expected behavior

avoid verilogparser header installation
install some ilang headers, maybe?

3. We should always use ila++.h in the example. But since changing it is simple, we can do it then.
4. Yes, we need to migrate previous examples as the simple example provided (simple).
5. I can add another test matrix using 16.04 (this would increase build time due to updating CMake).
6. Headers other than ilang++.h are not installed by default (not for users). However, you can turn it on with -DILANG_INSTALL_DEV=ON
7. We can disable it for now due to the intense deadline. However, it is dangerous since I've been spending time debugging for issues that could be found by the CI tests but did not due to the merge with an unchecked branch.

Actually, I don't get why 3 is a problem. Including cpp_api.h should never work even before installation, unless you put it as part of the library..., which you should never do for an example.

Then for 7, I will merge to the master branch on my side and use it for pull request.


Small addition to installing_cmake documentation

Just added one sentence to the documentation.
For me it was not clear what I have to do in the package that wants to use the CMake file.
Hope this will make it more clear for others.

Thank you, the addition is definitely helpful. Can you please add the same sentence in the sibling folder for "format 1".

I added it also to the format 1 documentation.

Thank you again for updating.


Handlebars in  become inline

When beautifying .html and .hbs (Mustache, Handlebars):
Expected behaviour:
  <head>

    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <title>Brenndel</title>
    <meta name="description" content="">
    <meta name="viewport" content="width=device-width, initial-scale=1">

    {{content-for 'head'}}

    <link rel="stylesheet" href="assets/vendor.css">
    <link rel="stylesheet" href="assets/brenndel.css">

    {{content-for 'head-footer'}}

  </head>

What happens instead:
  <head>

    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge">
    <title>Brenndel</title>
    <meta name="description" content="">
    <meta name="viewport" content="width=device-width, initial-scale=1">{{content-for 'head'}}

    <link rel="stylesheet" href="assets/vendor.css">
    <link rel="stylesheet" href="assets/brenndel.css">{{content-for 'head-footer'}}

  </head>

Handlebars in <head> are common in Ember projects. In the <body> such Handlebars are formatted correctly. Please ask Mustache to update their beautifiers accordingly.
Gist: https://gist.github.com/janwerkhoven/776f9ba4be40663ede83

I suspected Pretty Diff would be the default beautifier for Handlebars, but I cannot reproduce this problem with Pretty Diff.
Current: http://prettydiff.com/?m=beautifyl=html
Beta: http://prettydiff.com/ignore/testlocation/index.xhtml?m=beautify&l=html

Good point, my setting for HTML was set to JS Beautify. I switched to Pretty Diff and it formats the HTML correctly :)

I am thinking this issue is resolved, but I am wrong please reopen this issue.


Successful use with BeagleBone Images

Just wanted to give a heads-up to anyone else who is searching for a solution for another Single-board computer, that this is working well for images on my BeagleBone Black (BBB)

Glad to hear it worked for you! 😄


keepAlive doesn't work for iOS devices

In iOS when the application is suspended and returns to foreground there is a chunk error. This doesn't happen in Android and doesn't happen in the iOS simulator. However, it does occur with actual iOS devices.
Steps to repeat:

Using a physical iOS device.
Open a large complex React app in the react-native-static-server using react-native-webview.
Suspend the app.
Wait about 5 to 10 minutes.
Return to the app.

Expected behavior:
App should display at the same page at the time it was suspended. This is what happens with the Android device and in the iOS simulator.
Actual behavior:
An error occurs that the chunk cannot be loaded.

System:
OS: macOS 10.15.6
CPU: (4) x64 Intel(R) Core(TM) i5-4690 CPU @ 3.50GHz
Memory: 91.50 MB / 32.00 GB
Shell: 5.7.1 - /bin/zsh
Binaries:
Node: 14.12.0 - /usr/local/bin/node
Yarn: 1.22.5 - /usr/local/bin/yarn
npm: 6.13.4 - /usr/local/bin/npm
Watchman: 4.9.0 - /usr/local/bin/watchman
Managers:
CocoaPods: 1.8.4 - /usr/local/bin/pod
SDKs:
iOS SDK:
Platforms: iOS 13.7, DriverKit 19.0, macOS 10.15, tvOS 13.4, watchOS 6.2
Android SDK:
API Levels: 23, 28, 29, 30
Build Tools: 28.0.3, 29.0.2, 30.0.1
System Images: android-29 | Intel x86 Atom_64, android-29 | Google APIs Intel x86 Atom, android-29 | Google APIs Intel x86 Atom_64, android-29 | Google Play Intel x86 Atom, android-30 | Google APIs Intel x86 Atom_64, android-30 | Google Play Intel x86 Atom_64
Android NDK: Not Found
IDEs:
Android Studio: 4.0 AI-193.69<IP_ADDRESS>26763
Xcode: 11.7/11E801a - /usr/bin/xcodebuild
Languages:
Java: 1.8.0_242 - /usr/bin/javac
Python: 2.7.16 - /usr/bin/python
npmPackages:
@react-native-community/cli: Not Found
react: 16.13.1 => 16.13.1
react-native: 0.63.2 => 0.63.2
npmGlobalPackages:
react-native: Not Found

got any solution for this?


Make a standalone project that uses Hexagon

Currently, applications that use Hexagon must be built as a project along with the engine.  Simply put, the application requires the source code of the engine in order to be compiled.
It would be ideal to just be able to use the Hexagon.lib (and the header files if required) to compile a standalone application since it is generally unnecessary to make changes to the engine code and push the changes back upstream.  This would significantly simplify creating standalone applications.

Spdlog should be a dependency to the engine (Static Library).  This would remove the requirement for spdlog to be part of the include directories of the application projects since the engine would have all definitions and declarations pertaining to logging functionality.


[docs][v5] Has the -p option been removed?

When running webpack -p, this error appears:
error: unknown option '-p'

Repro: https://codesandbox.io/s/throbbing-smoke-z58iv?file=/package.json (ignore the code, but it has webpack v5 installed)

open the terminal, open a new tab (+ at the right)
Run yarn test-p or npm run test-p or even just npx webpack -p.
See the error appear.

Versions:
$ npx webpack -v
webpack 5.16.0
webpack-cli 4.4.0
webpack-dev-server 3.11.2

Questions
Has the -p option been removed?
If so:

In Production > CLI Alternatives it still mentions -p. Should this mention be removed? Silently, or should call out that -p has been removed?
To v5 from v4 doesn't mention -p. Is the removal worth mentioning here?
Should it be noted on https://github.com/webpack/changelog-v5?

Thanks

It is in somewhere in changelog for webpack-cli, -p was removed in favor --mode production

It is in somewhere in changelog for webpack-cli, -p was removed in favor --mode production

Thanks for the quick response. Also on the Production page, --optimize-minimize seems to be renamed to --optimization-minimize. I'll see if I can note these things in the changelog-v5 repo if that's fine with you.

Thanks for the quick response. Also on the Production page, --optimize-minimize seems to be renamed to --optimization-minimize. I'll see if I can note these things in the changelog-v5 repo if that's fine with you.

Let's keep open, we need update docs here

Let's keep open, we need update docs here

closed via https://github.com/webpack/webpack.js.org/pull/4466

closed via https://github.com/webpack/webpack.js.org/pull/4466


Single Double-byte character display problem

I've tried all the new versions, and it's not displaying properly.
When I try to edit a command, using double-byte characters makes the characters appear mangled and overlapping.

@he852100: Please provide an MCVE (Minimal, Complete, and Verifiable Example), along with details about your environment (OS, PS version).

I can see same problem in Windows10 Redstone5 Insider Preview Build17713(JA-JP),
Powershell version v10.0.17713.1000.
This problem does not occur in the Powershell_ISE(v10.0.17713.1000)

It's a stubborn problem, and you've never really solved it.
Change the window size, or remove the double-byte character normally. The fault recurs. It's universal。

When you enter a Chinese character, then delete it, or you want to insert other text before it, the fault occurs. Characters get messy
当输入一个中文字符，然后删除它，或者想在它之前插入其他文字，故障出现。字符变得混乱不堪，
In addition, when using a two-byte character variable, the variable reference fails
此外，当使用双字节字符变量时，变量引用会发生故障

/cc @daxian-dbw Maybe you could look the issue while working on PSReadline.

@he852100 We need the repro steps and the environment data for the reported issue. I cannot reproduce this with pwsh 7.0.0-preview.4

For the environment data, run the following script and copy/paste the output here.
& {
    $hostName = $Host.Name
    if ($hostName -eq "ConsoleHost" -and (Get-Command Get-CimInstance -ErrorAction SilentlyContinue)) {
        $id = $PID
        $inWindowsTerminal = $false
        while ($true) {
            $p = Get-CimInstance -ClassName Win32_Process -Filter "ProcessId Like $id"
            if (!$p -or !$p.Name) { break }
            if ($p.Name -eq "WindowsTerminal.exe") { $inWindowsTerminal = $true; break }
            $id = $p.ParentProcessId
        }
        if ($inWindowsTerminal) { $hostName += " (Windows Terminal)" }
    }

    "`nPS version: $($PSVersionTable.PSVersion)"
    $v = (Get-Module PSReadline).Version
    $m = Get-Content "$(Split-Path -Parent (Get-Module PSReadLine).Path)\PSReadLine.psd1" | Select-String "Prerelease = '(.*)'"
    if ($m) {
        $v = "$v-" + $m.Matches[0].Groups[1].Value
    }
    "PSReadline version: $v"
    if ($IsLinux -or $IsMacOS) {
        "os: $(uname -a)"
    } else {
        "os: $((dir $env:SystemRoot\System32\cmd.exe).VersionInfo.FileVersion)"
    }
    "PS file version: $($name = if ($PSVersionTable.PSEdition -eq "Core") { "pwsh.dll" } else { "powershell.exe" }; (dir $pshome\$name).VersionInfo.FileVersion)"
    "HostName: $hostName"
    "BufferWidth: $([console]::BufferWidth)"
    "BufferHeight: $([console]::BufferHeight)`n"
}

@he852100 Could you please add a comment why the issue closed? Fixed in 7.0.0-preview.4? Fixed in latest PSReadline?

Looks like this issue is still present for 2-byte and 4-byte characters in the latest windows 10 powershell.
Visual Studio shipped an integrated terminal that also reproduces this issue in VS and in Powershell:

@javierdlg Could you please check with latest PowerShell 7.1 RC and PSReadline 2.1.0 RC?


Not clear what the input TRAPI results URL should look like

It is not clear that a JSON TRAPI result URL is expected by the notebook as input.
Suggested solutions:

In the user input widget, "TRAPI Result URL" field could be renamed to "TRAPI Result URL (JSON)"
At the top of notebook, provide more details that a JSON TRAPI results URL is needed as input. This is not clear from the current description.

Reported by @khanspers

Good point. Or we could accept either, or even just the hash alone, and then construct the JSON URL?

I like the idea of accepting either a hash or a JSON URL.


dxForm throws the E1035 error in an Angular app which is built using the Angular CLI with the Production mode when the form has an item with dxTextArea

See the TestApp.zip project.
Steps to reproduce:

Open up the attached project.
Execute the following commands:

npm install
ng build --prod

Deploy the app to any web server
Open the app in a web browser and see the browser console.

To use the dxTextArea widget on the form, you need to import it into your application.
I've created a corresponding ticket in our Support Center to correct our documentation

Ok, thanks.
Adding the following code to the app.module.ts file solves the issue:
import {
  ..., DxTextAreaModule
} from 'devextreme-angular';
@NgModule({
  ...
  imports: [
    ...,
    DxTextAreaModule
  ],
  ...
})


Make integration tests for QA

hey yall
We need some tests!
Here's an example testing script:

https://github.com/datproject/dat-desktop/issues/138

working with dats

[ ] click 'create new dat' and share a local folder, you should see a new item in the list
[ ] click the link icon and it should copy the dat link to your clipboard
[ ] click the open in finder icon and it should open the folder in Finder.app
[ ] check that clicking cancel on the delete dialog cancels the dialog
[ ] click the delete icon and it should pop up a confirmation dialog to remove it
[ ] click 'import dat' and see if can downloads dat://f34f99538702f3b55ea3b88c9e374fb72db0ca35903c2249aaa09280accc2062
[ ] the progress bar should correctly show how much progress you have downloaded

Examples:

webtorrent uses tape as well as screenshot tests.
beaker

I think using tape for some of our basic state mutations would be good;
having the full range of integration tests might take a bunch of time and
right now is perhaps not the right time for that.
So far non-IO unit tests have been easy to write for our crash service, and
I think that might be great for an initial pass (:
https://github.com/yoshuawuyts/crash-reporter-service/tree/master/tests
I think one of the biggest pieces of untested code right now is the
dat-manager stuff, but I think now that multidrive is supported by dat-node
we can make this trivial / perhaps move out of our tree to something we can
add more tests too.
Does that make sense?
On Wed, Jan 18, 2017 at 10:30 PM Karissa McKelvey<EMAIL_ADDRESS>wrote:

hey yall
we need some tests
Examples:

webtorrent
https://github.com/feross/webtorrent-desktop/tree/master/test uses
tape as well as screenshot tests.
beaker https://github.com/beakerbrowser/beaker/tree/master/tests

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/datproject/dat-desktop/issues/155, or mute the thread
https://github.com/notifications/unsubscribe-auth/ACWlejPpOTXsQFFw26wW4__vROhHRXPfks5rToR6gaJpZM4Lnal5
.

As long as the tests catch bugs before users see them, that's what matters !

I've been scratching my head a lil over this as I'm not too familiar with Selenium and writing integration tests; I think I'd rather implement unit tests for our models first.
@karissa Is this something you're interested in picking up?

Another approach we could take is by unit-testing UI things through https://github.com/mantoni/choo-test - haven't tried the library but it could perhaps be a lil more robust compared to selenium. Or perhaps we should like do both?

Created issue https://github.com/dat-land/dat-desktop/issues/592 for porting the manual list entirely to integration tests. But I guess further issues might be useful too.


Don't think this was ready to publish

Looks like this and a few others in https://github.com/MicrosoftDocs/vsts-docs/commit/4995649c62ecf1d4e054b59907e208db0ab75def got pushed out by mistake

Document details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f3579700-2bcc-b38d-4112-c1024fee50fc
Version Independent ID: d6eb0b15-17a3-ee0a-f264-c86a6db41add
Content: Azure DevOps Pipelines New User Guide - Key Concepts
Content Source: docs/pipelines/basic-pipelines-concepts.md
Product: devops
GitHub Login: @erickson-doug
Microsoft Alias: douge

Ok we just fixed it, thank you!


Offer to syndicate to other catalogues

Description
The Mauro Data Mapper includes both RSS and OPML endpoints.  Syndicating to a catalogue using the RSS feed is implemented however the OPML feed s not yet exploited.  This feature request is to:

Use a list of known endpoints (this is the content of the local OPML feed)
Access the list of endpoints each of those known endpoints advertises (from the OPML feed)
Offer the ability to subscribe to these additional endpoints on the Subscribed Catalogue administration screen
Request appropriate API key (or use Public / Anonymous access)

Optional additional feature
Follow the onward OPML feeds to build a network (spider a self-describing network of Mauro Data Mapper catalogues).

Actually we're not using the RSS feed.
We have 2 endpoints which broadcast RSS and OPML however to actually be able to subscribe and import the subscribed models we needed to use our XML/JSON importers/exporters as we dont have a prescribed RSS or OPML format for the actual model and its content.
Therefore we are currently entirely reliant on subscribing to another MDM instance ONLY, so we use the /api/publishedModels endpoint which broadcasts in JSON, this is faster for us to process than trying to parse the RSS feed, and then we can talk to the MDM instance to export the model and import it into our MDM.
OPML and RSS only make sense when not talking to an MDM instance but another type of catalogue which can be programmed to render the RSS or OPML feed for all models and then for a requested model picked from that list.
We would also require apiKey access and user's knowledge of the "header" key used to indicate which header stores the ApiKey, either that or we have to recode the SubscribedCatalogue to handle all format of HTTP authentication which would then be controlled through the domain creation.
We would probably also need the endpoint to contact as part of the SubscribedCatalogue, as we cannot assume the models are actually broadcast at /feeds/all, along with the "type" of connection; e.g. MDM, RSS, OPML.
To be able to use OPML and RSS we need an XSD for both formats for each type of model and then an importer which can handle each format.
Once we have these importers then we can update the UI to handle any changes to the SubscribedCatalogue, at which point the backend would be responsible for actually handling anything, so there should be no other updates required for the UI


Uknown extension vscode.ipynb

All of a sudden (yesterday I was using the Python notebooks on a remote machine, then disconnected and today I connected again) I cannot even open ipynb files on VS Code.
I did not install other extension, nor did I upgrade VSC.
Version: 1.64.2 (user setup)
Commit: f80445acd5a3dadef24aa209168452a3d97cc326
Date: 2022-02-09T22:02:28.252Z
Electron: 13.5.2
Chromium: 91.0.4472.164
Node.js: 14.16.0
V8: 9.1.269.39-electron.0
OS: Windows_NT x64 10.0.19043

The remote machine is a kubernetes pod running linux ubuntu 20.04.
I searched but could not find any answer.
What did I do?

Remove extension Jupyter v2022.1.1301854968 (Microsoft)
Reloaded
Clicked on a .ipynb file
VS Code asked to install the required extensions, I accepted
VS Code reinstalled Jupyter v2022.1.1301854968 (Microsoft)
Reloaded
Re-opened a .ipynb file
Got the same error message on the unknown extension

This issue happened with past releases, I found many references in 2020. However, I could not find any solutions.
I have read somewhere that this might be related to the python interpreter. I tried to change the interpreted, choosing also "Python select interpreter": I get an error also with this: python.setInterpreter not found.
What caused this mess?

python.setInterpreter not found
This sounds like your python extension isn't configured correctly. Can you try reinstalling that extension? Also, what version of that extension are you using?

also, can you make sure that the Jupyter extension you are troubleshooting is the one on the remote machine, not the local instance of VS code.

Hello Aaron and thank you for your support. The remote Python environment
was working fine during the last connection. However it is possible, even
if I did not notice anything, that VSC got updated automatically, it seems
there was a recent update to the February 2022. I have found references to
the same issue where the cause was the update of the app.
After sending this message, i uninstalled the Python and the Jupyter
extensions by Microsoft both remotely and locally, removed the remote
.vscode/ server data and reinstalled. Now it is working fine again.
I have also disabled the automatic updates.
Il ven 4 mar 2022, 21:46 Aaron Munger @.***> ha scritto:

also, can you make sure that the Jupyter extension you are troubleshooting
is the one on the remote machine, not the local instance of VS code.
—
Reply to this email directly, view it on GitHub
https://github.com/microsoft/vscode-jupyter/issues/9235#issuecomment-1059518593,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABTIBV4G54COSU3GHY4E6B3U6JZCDANCNFSM5P44E5JA
.
You are receiving this because you authored the thread.Message ID:
@.***>

thanks for the update @thistlillo. So are you on the latest release for everything now (VSC, jupyter, Python), or did you have to revert back to an older version to get it working?

Actually there is a bigger problem here, at least on my installation.
I have now the latest version of everything (VSC, Python and Jupyter extensions by Microsoft) and every time I close the remote connection, the python setup breaks.
For example, two hours ago I was working with python files and jupyter notebooks on the remote hosts, now I have just reconnected and nothing is working any more.
Jupyter notebooks are not even opened, Python .py files are read as normal txt files. Indeed, if I try and set a Python interpreter I get this message :

I do not know what update broke everything, but VSC has become unusuable.

Yes, again today. After I disconnect from the remote host the Python setup gets messed up:

May be this is due to some other extensions, however I did not update anything, if not VSC that got updated automatically.

Solved, the issue was caused by an extension for syncing Settings. Despite having already disabled the syncing of potentially conflicting settings, after the update of VSC this extension was causing issues.
This experience, like others, make all the "extensions" idea, even if beautiful, quite fragile and annoying: I think that currently only extensions from major players can really be used in a production environment. It is not reasonable to pretend users to make an extensive check of all the extensions at every update of VSC.


fix #72187

There is two way to fix this issue, and because I think this bug is caused by mistake, so I just revert the implements.
And I think the case needs a test to cover, but I didn't find vscode.openFolder test,  I'll really appreciate if someone can teach me how to do this.
Thanks.    : )

@LeuisKen Thanks for helping. I'd suggest to make the fix in apiCommands.

Looks good, thanks!


Log messages from a hierarchy sometimes don't show up

Given this config,
appenders:
  main:
    kind: console
root:
  level: warn
  appenders:
    - main
loggers:
  log4rs_issue:
    level: debug
  log4rs_issue::nested:
    level: trace

messages at the DEBUG level don't show up.. sometimes. There's a repro in this repository. The repro should be runnable after a git clone and cargo run. Multiple invocations may be necessary for the issue to show up.

Oops, I had pushed the wrong config initially. Now the log4rs_issue.level should be debug. I pushed a fix to the repro.

Released v0.4.1

Thanks @sfackler!


embedded newline in Python code causes next line indent to be wrong

Issue Type: Bug
If there is an embedded (explicit) newline in a string in a Python statement,
the auto-indent of the next line is wrong.
Example:
print("aaa\nbbb")
Pressing return/enter after the above line causes the indent to be several spaces in from the left margin.
This doesn't happen with the following statement where the newline is replaced by a space:
print("aaa bbb")
Extension version: 2019.2.5558
VS Code version: Code 1.32.3 (a3db5be9b5c6ba46bb7555ec5d60178ecc2eaae4, 2019-03-14T22:46:48.547Z)
OS version: Darwin x64 18.2.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz (8 x 2700)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: enabledrasterization: enabledsurface_synchronization: enabled_onvideo_decode: enabledwebgl: enabledwebgl2: enabled

Load (avg)
2, 2, 2

Memory (System)
16.00GB (2.54GB free)

Process Argv
-psn_0_4178940

Screen Reader
no

VM
0%

Duplicate of https://github.com/Microsoft/vscode-python/issues/4563


Run stats on multiple rasters

A common pattern is to grab a set of stats from a series of rasters. Currently, one can run raster stats separately and then merge the data structures (see https://github.com/perrygeo/pyimpute/blob/master/src/pyimpute/_main.py#L33) but it might be convenient to support something like this in raster_stats directly.

Implications for API:
Currently, a single raster is expected as the second argument:
s1 = zonal_stats("shapes.shp", "raster1.tif")
s2 = zonal_stats("shapes.shp", "raster2.tif")

But we could probably support an optional list/iterable of rasters:
s = zonal_stats("shapes.shp", ["raster1.tif", "raster2.tif"])

Internally, zonal_stats would only need to create the feature masks once instead of for each raster.
The slightly tricky part is the output. With multiple rasters comes the need to differentiate them. The way many GIS packages handle this general problem is through prefixing:
{'__fid__': 1,
 'raster1_mean`: 234.5,
 'raster2_mean`: 234.5}

Which works if a reasonable prefix can be deduced from the raster representation. In the case of passing in ndarrays instead of file paths, it would be hard to generate consistent and meaningful prefixes when constructing these keys. If rasters have the same basename in different directories, you would need to disambiguate further. All of this means that the keys in the returned objects may not be intuitive or discoverable; a serious problem for downstream code that tries to use it.
I would advocate for a new prefixes keyword argument that is a list (of the same length as the raster list) and  would explicitly define the prefixes for each raster.
s = zonal_stats("shapes.shp", ["raster1.tif", "raster2.tif"], prefixes=['r1', 'r2'])
assert 'r1_mean' in s[0].keys()

Without prefixes, specifying a list of rasters will raise an Exception;  the prefixes kwarg will be required if the rasters are an iterable.
Comments welcome...

Option 2, alternative to above:
Accept a rastercollection type dict that could contain metadata like prefixes, affine transforms, paths, etc.
[{ 'type': 'rastercollection',
   'rasters': [
       {'type': 'file', 'path': 'raster1.tif`, 'prefix': 'r1', ...},
       {'type': 'file', 'path': 'raster1.tif`, 'prefix': 'r1', ...},
    ]}]

I'm second guessing the utility of this. It seems like running zonal_stats once per raster band is an acceptable alternative. The only reason to combine them would be if the geometry rasterization step is a performance bottleneck and it would be nice to rasterize once and use against multiple rasters. But I'd need to see some profiling data to be convinced. Will re-open if needed...


Add musl paths to the iconv search list

OCaml officially supports a musl flavor, but ocaml-text is currently unusable with it.
The issue is that musl provides its own implementation of libiconv integrated into the main static library, but setup.ml of ocaml-text does not search musl library paths for it and assumes that libiconv is not available.
This patch works around the issue by adding typical musl paths to the lookup list. I've added paths used by Debian and Fedora/RHEL derivcatives, which should cover most systems I hope.

Ok. It would be best to switch the build system of this to dune, though.

Yes, this is a band aid patch just to make it build with minimal changes to the existing code for now.

Thanks.


Re-indented code, and added missing documentations

Noticed code was unreadable, so had to re-indent it. Also added descriptions to function parameters that were missing.

Thank you. I'd review it later in the evening and do a merge.

You are welcome. Also, I'm about to write this same stuff for a different language, I'll need periodic guide on how to implement some things(Though I understand the php version of this library). How can you be contacted.

Sorry, I was not able to review it yesterday.
Sure, would be willing to help you can hit me up on twitter @JonathanItakpe

???

Sorry man,... Merged && Released.


Bump Spark, Scala, Hadoop dependency versions

Apache Spark version 2.0.1 was released on 03 Oct 2016 and defaults to Scala version 2.11.8 and Hadoop 2.7 and later.
Apache Spark version 1.6.2 was released on 25 June 2016 and defaults to Scala version 2.10.5 and Hadoop 2.6.  When bumping the Scala version to 2.10.5 downstream I see other libraries requiring 2.10.6.

Is ADAM working on Spark 2.0?  Has anyone looked at running ADAM atop AWS EMR?

Is ADAM working on Spark 2.0?

Yes, as of version 0.20.0, released last week.

See also
https://issues.apache.org/jira/browse/SPARK-18138

Sigh! Reopening this issue. See comment; TL;DR is that #1254 spuriously passed but the move_to_spark2.sh script is broken now on ToT. If no one else is interested, I'll hack on this in the AM.


Add C+CUDA single-GPU implementation for PFSP

This PR adds a single-GPU B&B implementation for the PFSP in C+CUDA.

Checked on your comments Guillaume. I will start doing the same on the Multi-GPU approach before you start checking it also for saving us some time.


add test case to reporduce the error

no need to run the workflows. I canceled them

no idea what this is about


Undeprecate MaxTokens

A similar PR may already be submitted!
Please search among the Pull request before creating one.
If your changes introduce breaking changes, please prefix the title of your pull request with "[BREAKING_CHANGES]". This allows for clear identification of such changes in the 'What's Changed' section on the release page, making it developer-friendly.
Thanks for submitting a pull request! Please provide enough information so that others can review your pull request.
Describe the change
Please provide a clear and concise description of the changes you're proposing. Explain what problem it solves or what feature it adds.
Provide OpenAI documentation link
Provide a relevant API doc from https://platform.openai.com/docs/api-reference
Describe your solution
Describe how your changes address the problem or how they add the feature. This should include a brief description of your approach and any new libraries or dependencies you're using.
Tests
Briefly describe how you have tested these changes. If possible — please add integration tests.
Additional context
Add any other context or screenshots or logs about your pull request here. If the pull request relates to an open issue, please link to it.
Issue: #XXXX

Merge activity

Nov 26, 7:22 AM EST: A user started a stack merge that includes this pull request via Graphite.


Upgrade banyandb to 0.5.0

@hanahmily Could you check why e2e fails?

@hanahmily Could you check why e2e fails?

Since we break change the banyandb client configuration in OAP, you'd better upgrade skywalking-helm firstly.

Yes, we did that.

Could you lock the skywalking-helm commit ID? Use the latest seems very tricky.

Could you lock the skywalking-helm commit ID? Use the latest seems very tricky.

Where used the latest？

Rename should be good enough. I was misguided.


cryptsetup: 2.3.3 -> 2.3.4

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/cryptsetup/versions.
meta.description for cryptsetup is: "LUKS for dm-crypt"
meta.homepage for cryptsetup is: "https://gitlab.com/cryptsetup/cryptsetup/"
meta.changelog for cryptsetup is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 2.3.4 with grep in /nix/store/d5fqn24bsi8l72jw89k5zb0wh4fliajs-cryptsetup-2.3.4

directory tree listing: https://gist.github.com/319135820d151de60752171742c3d245

du listing: https://gist.github.com/15ca5c0b754d21d2f8f214b6efcdb71a

Rebuild report (if merged into master) (click to expand)

25969 total rebuild path(s)

9565 package rebuild(s)

9560 x86_64-linux rebuild(s)
8228 i686-linux rebuild(s)
177 x86_64-darwin rebuild(s)
8004 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
AusweisApp2
DisnixWebService
EmptyEpsilon
Literate
MIDIVisualizer
MMA
OVMF
OVMF-CSM
OVMF-secureBoot
R
SDL
SDL2
SDL2_gfx
SDL2_image
SDL2_mixer
SDL2_net
SDL2_ttf
SDL_Pango
SDL_gfx
SDL_gpu
SDL_image
SDL_mixer
SDL_net
SDL_sound
SDL_stretch
SDL_ttf
Sylk
_1password-gui
_20kly
_3mux
_90secondportraits
a2jmidid
abbaye-des-morts
abcde
abcl
abiword
abootimg
accountsservice
acoustidFingerprinter
acsccid
act
adapta-gtk-theme
adementary-theme
adlplug
adminer
adobe-reader
adom
adoptopenjdk-icedtea-web
adwaita-qt
aegisub

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/d5fqn24bsi8l72jw89k5zb0wh4fliajs-cryptsetup-2.3.4 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A cryptsetup https://github.com/r-ryantm/nixpkgs/archive/233ee2acfa765f4a6ba45e2c95a00411c0088921.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/d5fqn24bsi8l72jw89k5zb0wh4fliajs-cryptsetup-2.3.4
ls -la /nix/store/d5fqn24bsi8l72jw89k5zb0wh4fliajs-cryptsetup-2.3.4/bin

Pre-merge build results
NixPkgs review skipped

Maintainer pings

https://gitlab.com/cryptsetup/cryptsetup/-/blob/master/docs/v2.3.4-ReleaseNotes


correct go reference docs menu frontmatter

Summary

Currently, on the Paketo site, there are 2 Reference sections. This is caused by a typo in the frontmatter on the Go Reference docs page.

This fix eliminates the double header.
Use Cases

Checklist

[x] I have viewed, signed, and submitted the Contributor License Agreement.
[ ] I have linked issue(s) that this PR should close using keywords or the Github UI (See docs)
[ ] I have added an integration test, if necessary.
[ ] I have reviewed the styleguide for guidance on my code quality.
[ ] I'm happy with the commit history on this PR (I have rebased/squashed as needed).

PR DEPLOYED TO: https://paketo-staging--fix-ref-sidebar-pood3smj.web.app
SITE EXPIRES AT: 2021-07-10T20:02:49.013494329Z (in 72h)


Remove DWQAssessmentUnits from SGID

Summary

Internal Dataset Name: Environment.DWQAssessmentUnits
External Dataset Name: Utah DWQ Assessment Units
ArcGIS Online Url: https://www.arcgis.com/home/item.html?id=0f39afb3b29d4c0a8abf7c46ed2e0354

This is an out-of-date layer that was never cleaned up.
Comments from Mark Stanger on 10/1:

[This layer] is very out-of-date. I recognize assessment units, or the lack thereof, as being several years old. For example, the Great Salt Lake was one assessment unit (AU) but years ago was split into four AUs: Gunnison Bay, Gilbert Bay, Bear River Bay and Farmington Bay.
Another example are the AUs in the Price River area that have an upper elevation boundary of 7200 or 7500 feet, such as Lower Grassy Trail Creek (UT14060007-012). I cannot remember if those specific boundaries were ever finalized/approved.
I'm still looking for the source data that matches Scott's reference, but I am certain it is no longer applicable.

Migration Guide
This dataset has been replaced by Utah Assessed Waters.
Action items

Assign a person who should complete the task by replacing name with their github @name.
Check [x] the box when the task is completed and add the date of completion.
~Strike~ out all items that do not apply.

Soft Delete
The purpose of the soft delete is to ensure that all of our users and applications have gracefully migrated off of the dataset. Soft deletes will remain in effect for 14 days. During this time, we will have the ability to restore the dataset to its original SGID offering(s). After these 14 days, the item is then ready for a hard delete.
Note: If this dataset is being replaced, then wait until the new data is publicly available before completing these steps:

[x] Append "(Mature Support)" to the end of the item title in the SGID.META.AGOLItems table (@stdavis, completed: 2024/10/07)
[x] Remove all tags other than "Deprecated" in the SDE metadata (@stdavis, completed: 2024/10/07)
[x] Add note to SDE description noting when layer will be deleted and any replacement layer (@stdavis, completed: 2024/10/07)
[x] Update the SGID Index row as deprecated by pasting the related Porter issue URL in the "porterUrl" field and setting the value of the "ugrcStatus" field as "removed". Also update the "refreshCycle" field (@stdavis, completed: 2024/10/07)
[x] Change Authoritative field to d in SGID.META.AGOLItems to automatically set the Deprecated AGOL flag. Allow the d to persist through one run of Auditor - currently, Auditor runs daily at 5:00am (@stdavis, completed: 2024/10/07)

After at least one successful run of Auditor:

[x] Remove the row from the SGID.META.AGOLItems table. This will trigger the removal of this item in Open SGID (@stdavis, completed: 2024/10/21)
[x] Unshare the item from its SGID group, which will remove it from the SGID on ArcGIS (@stdavis, completed: 2024/10/21)
~- [ ] Check if this layer in the base maps.  It is recommended to complete the soft delete process before moving on to these steps. If you decide to skip the soft delete, note that you will need to incorporate some of those steps here.

[ ] Manually remove data from the Internal SGID (name, completed: 2024/00/00)

[ ] Deprecated database layers should be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > internal_db_sgid_layers (name, completed: 2024/00/00).

[ ] Remove ArcGIS Online item: (name, completed: 2024/00/00)

Manually delete the AGOL item
-OR-
Unshare by changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to something other than an Item ID and manually changing the sharing settings (remove the item from all SGID groups, remove Public sharing),
-OR-
Shelve the data by copying the row from SGID.META.AGOLItems to the AGOLItems_shelved table in AGOL and changing the AGOL_ITEM_ID field in SGID.META.AGOLItems to shelved or some other note.
Deprecated AGOL items can be backed up on Google Drive > AGRC Projects > SGID > deprecated layers > agol_sgid_layers.
~- [ ] Remove Farm from AGOL connection (name, completed: 2024/00/00)~

[ ] Update the SGID Index fields: "arcGisOnline", "openSgid", "openSgidTableName"
[x] Update relevant gis.utah.gov data pages (including downloadMetadata.ts) (@stdavis, completed: 2024/10/28)
[ ] Update SGID.META.AGOLItems table (name, completed: 2024/00/00)

cut and paste row to AGOLItems_shelved table if shelving (see below)
set the AGOL_ITEM_ID field to hosted by <agency> for Farm from AGOL
set the AGOL_ITEM_ID field to exclude from AGOL to not publish to ArcGIS Online

[ ] Delete Google Drive data (name, completed: 2024/00/00)
[x] Remove row from SGID.META.ChangeDetection (@stdavis, completed: 2024/10/28)
[x] Remove data from forklift hashing and receiving (@stdavis, completed: 2024/10/28)
[x] Remove row from data/hashed/changedetection.gdb/TableHashes (@stdavis, completed: 2024/10/28)

Shelve/Static
Choose one based on situation.

[ ] Upload to UtahAGRC/AGRC_Shelved folder in AGOL (New shelved item not already in AGOL) (name, completed: 2024/00/00)
[ ] Move existing AGOL item to AGRC_Shelved AGOL folder (shelving an item already in AGOL) (name, completed: 2024/00/00)
~- [ ] Upload to appropriate UtahAGRC/{SGID Category} folder in AGOL (for static datasets) (name, completed: 2024/00/00)~

Add record to table.

[ ] Add record to AGOLItems_shelved table in ArcGIS Online with shelved or static in the CATEGORY field (name, completed: 2024/00/00)

:robot: Automation validation

Assign yourself or someone to check the item by replacing name with their github @name.
Check [x] the box and add the date of verification 2020/01/01 when the task is verified.
~Strike~ out all items that do not apply.

[x] Remove data from Open SGID (@stdavis on 2024/10/28)
[x] sgid-index (@steveoh on 2024/10/28)
[x] Auditor sets appropriate shelved/static/Deprecated information (@jacobdadams on 2024/10/08)

Are there service dependencies

[x] Are clients querying this data with the WebAPI? This dashboard may be helpful.
[x] Notify Don Jackson (don.jackson1 at motorolasolutions.com) if the data is in the Next-Generation 911 Motorola Aware Map? (@gregbunce on 2024/00/00)
[x] Does any other application depend on this data?

[x] The DEQ Tank risk took relies on this data https://github.com/agrc/DEQ-TankRisk/blob/main/src/tank_risk_tool.pyt#L694 (@steveoh on 2024/11/08)

Notification

[x] Twitter (@steveoh)

Group Task Assignments

Check [x] the box when you have assigned all the tasks relevant to your group.

[x] Data Team (@ZachBeck)
[x] Dev Team (@steveoh)
[x] Cadastre Team (@rkelson)

I need some help with the shelved tasks. I'm not sure how those are supposed to be done.

conductor results for tasks - 356

check
status

@stdavis has completed 0 out of 12 tasks
:no_entry:

@steveoh has completed 0 out of 3 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

@gregbunce has completed 0 out of 2 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:no_entry:

open sgid
:no_entry:

open data
:no_entry:

arcgis online
:no_entry:

stewardship

- porter issue link
:no_entry:

conductor results for tasks - 356

check
status

@stdavis has completed 5 out of 12 tasks
:no_entry:

@steveoh has completed 0 out of 3 tasks
:no_entry:

jacobdadams has completed 1 out of 1 tasks
:+1:

@gregbunce has completed 0 out of 2 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 356

check
status

@stdavis has completed 5 out of 12 tasks
:no_entry:

@steveoh has completed 0 out of 3 tasks
:no_entry:

jacobdadams has completed 1 out of 1 tasks
:+1:

@gregbunce has completed 0 out of 2 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:no_entry:

open sgid
:no_entry:

open data
:no_entry:

arcgis online
:no_entry:

stewardship

- porter issue link
:+1:

conductor results for tasks - 356

check
status

@stdavis has completed 7 out of 12 tasks
:no_entry:

@steveoh has completed 0 out of 3 tasks
:no_entry:

jacobdadams has completed 1 out of 1 tasks
:+1:

@gregbunce has completed 0 out of 2 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:+1:

stewardship

- porter issue link
:+1:

conductor results for tasks - 356

check
status

stdavis has completed 12 out of 12 tasks
:+1:

steveoh has completed 3 out of 3 tasks
:+1:

jacobdadams has completed 1 out of 1 tasks
:+1:

gregbunce has completed 1 out of 1 tasks
:+1:

@ZachBeck has completed 0 out of 1 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:+1:

stewardship

- porter issue link
:+1:

Richard Saathoff has brought to our attention that the deq tank risk tool relies on this data which is no longer available in the open sgid. He's going to run with the mature support data in agol for this months report.

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:+1:

stewardship

- porter issue link
:+1:

conductor results for tasks - 356

check
status

stdavis has completed 12 out of 12 tasks
:+1:

steveoh has completed 4 out of 4 tasks
:+1:

jacobdadams has completed 1 out of 1 tasks
:+1:

gregbunce has completed 1 out of 1 tasks
:+1:

@ZachBeck has completed 0 out of 1 tasks
:no_entry:

rkelson has completed 1 out of 1 tasks
:+1:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:+1:

stewardship

- porter issue link
:+1:

conductor results for tasks - 356

check
status

stdavis has completed 12 out of 12 tasks
:+1:

steveoh has completed 4 out of 4 tasks
:+1:

jacobdadams has completed 1 out of 1 tasks
:+1:

gregbunce has completed 1 out of 1 tasks
:+1:

ZachBeck has completed 1 out of 1 tasks
:+1:

rkelson has completed 1 out of 1 tasks
:+1:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:+1:

stewardship

- porter issue link
:+1:

conductor results for tasks - 356

check
status

stdavis has completed 12 out of 12 tasks
:+1:

steveoh has completed 4 out of 4 tasks
:+1:

jacobdadams has completed 1 out of 1 tasks
:+1:

gregbunce has completed 1 out of 1 tasks
:+1:

ZachBeck has completed 1 out of 1 tasks
:+1:

rkelson has completed 1 out of 1 tasks
:+1:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:+1:

stewardship

- porter issue link
:+1:

@stdavis does this layer need to be shelved or removed entirely?

does this layer need to be shelved or removed entirely?

It's up to the data team. I don't have any preference. I don't know anything more about it other than what I've put in this issue.

Ok, I'll remove it and keep it consistent with the other layers in this set of porter issues.

conductor results for tasks - 356

check
status

stdavis has completed 12 out of 12 tasks
:+1:

steveoh has completed 4 out of 4 tasks
:+1:

jacobdadams has completed 1 out of 1 tasks
:+1:

gregbunce has completed 1 out of 1 tasks
:+1:

ZachBeck has completed 1 out of 1 tasks
:+1:

rkelson has completed 1 out of 1 tasks
:+1:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:no_entry:

meta table
:+1:

stewardship

- porter issue link
:+1:

@ZachBeck It looks like you mark the task to assign data team tasks as complete but there are a few that seem like data team tasks without names on them. Are you expecting those to be done by our team?

No, just getting sloppy in my old age. I'll take care of them.

conductor results for tasks - 356

check
status

stdavis has completed 12 out of 12 tasks
:+1:

ZachBeck has completed 5 out of 5 tasks
:+1:

steveoh has completed 4 out of 4 tasks
:+1:

jacobdadams has completed 1 out of 1 tasks
:+1:

gregbunce has completed 1 out of 1 tasks
:+1:

rkelson has completed 1 out of 1 tasks
:+1:

conductor results for environment.DWQAssessmentUnits

check
status

internal sgid
:+1:

meta table
:+1:

stewardship

- porter issue link
:+1:


Problem with insert Double into DoubleColumn

Hi,
I'm working with scala 2.10/phantom 1.21, and getting the following error when attempting to insert a Double model value into a service DoubleColumn:
[ERROR] /opt/Sylvester/feed/src/main/scala/org/apache/spark/feed/service/CassandraSvcs.scala:144: type mismatch;
found   : org.apache.spark.feed.model.LocationModel => x$57.latitude.type forSome { val x$57: org.apache.spark.feed.model.LocationModel }
required: org.apache.spark.feed.model.LocationModel => com.websudos.phantom.column.AbstractColumn[Any]
[ERROR]           .value(_.latitude, crime.getLocation_1.getLatitude)
Any ideas/ comments?
Thanks!
John

Hi @uover82 ,
You are obviously providing the wrong type, getLatitude is not returning a double.
Regards.

Hi Flavian,
Thank you for your help [&#X1f60a]
Things are a little complicated in that I've also integrated Socrata/soda-java for api access - I'll explain:
The insert looks like:
    locationModel.insert
      .value(_.id, location_id)
      .value(_.latitude, crime.getLocation_1.getLatitude)
      .value(_.longitude, crime.getLocation_1.getLongitude)
      .value(_.address_id, address_id)
      .statement()
      .runWith(ConsistencyLevel.QUORUM)

Location bean (soja-java) like this:
public Double getLatitude() {
    return latitude;
}

public void setLatitude(Double latitude) {
    this.latitude = latitude;
}

model is like this:
object latitude extends DoubleColumn(this)
object longitude extends DoubleColumn(this)
entity is like this:
latitude: Double,
longitude: Double,
Should the underlying bean return double or Double?
Thanks
John

From: Flavian Alexandru<EMAIL_ADDRESS>Sent: Thursday, February 4, 2016 5:14 PM
To: websudos/phantom
Cc: John Harrison
Subject: Re: [phantom] Problem with insert Double into DoubleColumn (#415)
Hi @uover82https://github.com/uover82 ,
You are obviously providing the wrong type, getLatitude is not returning a double.
Regards.

Reply to this email directly or view it on GitHubhttps://github.com/websudos/phantom/issues/415#issuecomment-180136493.

It's simple, scala.Double is not the same as java.lang.Double. Use getLongitude.doubleValue, the doubleValue part should come from Scala automatically as an implicit value class augmentation.

Works like a charm, Flavian [&#X1f60a]  Thanks for the insight!
John

From: Flavian Alexandru<EMAIL_ADDRESS>Sent: Thursday, February 4, 2016 5:47 PM
To: websudos/phantom
Cc: John Harrison
Subject: Re: [phantom] Problem with insert Double into DoubleColumn (#415)
It's simple, scala.Double is not the same as java.lang.Double. Use getLongitude.doubleValue, the doubleValue part should come from Scala automatically as an implicit value class augmentation.

Reply to this email directly or view it on GitHubhttps://github.com/websudos/phantom/issues/415#issuecomment-180149614.


public construct_auth_token()

The base supports only default credentials. This patch exposes construct_auth_token() which can allow a user to generate a token from custom credentials.

I overlooked this function. Thank you!


EOF in inputstream, when when bodyPatterns and multipartPatterns are used

with commit https://github.com/tomakehurst/wiremock/commit/64012fccc130aa7d4912997a2fad6d9cbb25c0f6#diff-59cd8a8de7281c77e950bd5ac9398d38L276-R273
the call to getBody() function was removed, thus the body isn't cached in cachedBody and more important a first call to getBody() will read the inputstream up to EOF, so that a call to getParts() afterwards, can't parse anything.
I faced this problem first with wiremock 2.21 (last working 2.20, which matches the commit above, which was released in 2.21).
How to reproduce:
Take one test case which has a mapping with multipartPatterns and add another one which checks bodyPatterns. In this case wirmock will call the getBody() first, reads the stream up to EOF, then cannot read the multipart and reports [Multipart request body] is not present. If multipartPatterns alone is tested, everything is fine.

Thanks for reporting this. Please could you post a test case that reproduces it?

Sure, here were go: https://github.com/pschwager/wiremock-1179
if you remove the bodyPatterns in conflicting.json, then the test is green.

Wiremock Log:
                                               =======================

-----------------------------------------------------------------------------------------------------------------------
| Closest stub                                             | Request                                                  |
-----------------------------------------------------------------------------------------------------------------------
                                                           |
POST                                                       | POST
/upload                                                    | /upload
                                                           |
Content-Type [contains] : multipart/form-data              | Content-Type:
                                                           | multipart/form-data;boundary=Boundary_1_639769517_1567107
                                                           | 752214
                                                           |
[Multipart request body]                                   |                                                     <<<<< [Multipart request body] is not present
                                                           |
-----------------------------------------------------------------------------------------------------------------------

Thanks - working test cases very much appreciated!


Issue65 existing tests to coffee script

Fixes #65
Converts existing js based tests to CoffeeScript ☕

[x] ApiController.test
[x] UserController.test

To test:

$npm test

  ․․․․․․․․․

  6 passing (1s)
  3 failing

  1) Requests to the root (/user/password) path POST: Valid password request with only user_id returns expected properties.:
     Uncaught AssertionError: expected Object { email: '', mobile: '', user_id: '54f9e1c8469c64df6c8b4568' } to have property activity
    at Assertion.fail (node_modules/should/lib/assertion.js:92:17)
    at Assertion.Object.defineProperty.value [as property] (node_modules/should/lib/assertion.js:164:19)
    at Test.<anonymous> (test/integration/controllers/v1/UserController.test.js:57:30)
    at Test.assert (node_modules/supertest/lib/test.js:156:6)
    at Server.assert (node_modules/supertest/lib/test.js:127:12)
    at emitCloseNT (net.js:1519:8)

  2) Requests to the root (/user/password) path POST: Valid password request with only email returns expected properties.:
     Uncaught AssertionError: expected Object { email<EMAIL_ADDRESS>mobile: '', user_id: '' } to have property activity
    at Assertion.fail (node_modules/should/lib/assertion.js:92:17)
    at Assertion.Object.defineProperty.value [as property] (node_modules/should/lib/assertion.js:164:19)
    at Test.<anonymous> (test/integration/controllers/v1/UserController.test.js:83:30)
    at Test.assert (node_modules/supertest/lib/test.js:156:6)
    at Server.assert (node_modules/supertest/lib/test.js:127:12)
    at emitCloseNT (net.js:1519:8)

  3) Requests to the root (/user/password) path POST: Valid password request with only mobile returns expected properties.:
     Uncaught AssertionError: expected Object { email: '', mobile: '15556669999', user_id: '' } to have property activity
    at Assertion.fail (node_modules/should/lib/assertion.js:92:17)
    at Assertion.Object.defineProperty.value [as property] (node_modules/should/lib/assertion.js:164:19)
    at Test.<anonymous> (test/integration/controllers/v1/UserController.test.js:109:30)
    at Test.assert (node_modules/supertest/lib/test.js:156:6)
    at Server.assert (node_modules/supertest/lib/test.js:127:12)
    at emitCloseNT (net.js:1519:8)

Should the .map and .js files not be committed to the repo? What do you suggest for the workflow  to ensure all .coffee files in a project are compiled to .js files to allow for test / development?

Map and js files should not be committed. In sails they have built-in support for coffescript so it's converted automatically on server.
Regarding mocha, take a look at this article: http://code.tutsplus.com/tutorials/better-coffeescript-testing-with-mocha--net-24696

👍


RFC: ByteToMessageDecoder 2

Motivation:
ByteToMessageDecoder is almost(?) impossible to use correctly with reentrancy. We can't access the bytes when re-entered (exclusivity) so we stash them away, ie. old, already processed bytes are still reachable when being re-entered, ...
Also, it's a bad API as the user is expected to only overwrite some of the protocol requirements but not others. Oh, and the default implementations (decodeLast) were also broken.
Modifications:

rewrite the whole thing, re-entrancy-safe
ByteToMessageDecoder is no longer a ChannelInboundHandler, it needs to be wrapped in a ByteToMessageHandler
way more tests

Result:
sanity
What's missing?

[ ] currently if removeHandler is called within channelRead's call stack, we call decodeLast after returning from channelRead (because we need to (exclusivity)) but then we're already no longer in the pipeline and therefore can't pass on any leftovers...
[ ] should make offer MyByteToMessageDecoder().makeHandler() as a factory for making a ByteToMessageHandler wrapper?

@swift-nio-bot test this please

@swift-nio-bot test this please

@Lukasa thanks, updated


[dev-vm] chef-server omnibus vm broken unable to build locally.

As a Chef Infra Server dev I would like to be able to build omnibus packages locally.
currently
cd chef-server/omnibus
kitchen converge ubuntu-1804
fails with
 Transferring files to <default-ubuntu-1804>
       +---------------------------------------------+
       ✔ 2 product licenses accepted.
       +---------------------------------------------+
       Starting Chef Infra Client, version 17.0.242
       Patents: https://www.chef.io/patents
       Creating a new client identity for default-ubuntu-1804 using the validator key.
       resolving cookbooks for run list: ["apt::default", "omnibus::default", "zip"]
       Synchronizing Cookbooks:
         - chef-sugar (5.1.8)
         - omnibus (5.7.2)
         - apt (7.2.0)
         - build-essential (8.2.1)
         - remote_install (2.0.0)
         - zip (1.1.0)
         - git (10.0.0)
         - wix (5.0.0)
         - chef-ingredient (3.1.2)
         - homebrew (5.0.8)
         - seven_zip (3.1.2)
         - mingw (2.1.0)
         - windows (6.0.1)
       Installing Cookbook Gems:
       Compiling Cookbooks...
       [2021-05-03T20:44:21+00:00] WARN: Resource windows_user_privilege built into Chef Infra Client is being overridden by the resource from a cookbook. Please upgrade your cookbook or remove the cookbook from your run_list.
       [2021-05-03T20:44:21+00:00] WARN: chef-sugar::default no longer needs to be included in your runlist. Instead simply depend on the chef-sugar cookbook and the gem will be installed and loaded automatically.

       ================================================================================
       Recipe Compile Error in /tmp/kitchen/cache/cookbooks/omnibus/recipes/default.rb
       ================================================================================

       NoMethodError
       -------------
       undefined method `chef_ingredient' for cookbook: omnibus, recipe: _omnibus_toolchain :Chef::Recipe

       Cookbook Trace: (most recent call first)
       ----------------------------------------
         /tmp/kitchen/cache/cookbooks/omnibus/recipes/_omnibus_toolchain.rb:22:in `from_file'
         /tmp/kitchen/cache/cookbooks/omnibus/recipes/_user.rb:24:in `from_file'
         /tmp/kitchen/cache/cookbooks/omnibus/recipes/_common.rb:33:in `from_file'
         /tmp/kitchen/cache/cookbooks/omnibus/recipes/default.rb:21:in `from_file'

       Relevant File Content:
       ----------------------
       /tmp/kitchen/cache/cookbooks/omnibus/recipes/_omnibus_toolchain.rb:

        15:  # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
        16:  # See the License for the specific language governing permissions and
        17:  # limitations under the License.
        18:  #
        19:
        20:  arch = (windows_arch_i386? || i386?) ? 'i386' : node['kernel']['machine']
        21:
        22>> chef_ingredient node['omnibus']['toolchain_name'] do
        23:    version node['omnibus']['toolchain_version']
        24:    channel node['omnibus']['toolchain_channel'].to_sym
        25:    architecture arch
        26:    platform_version_compatibility_mode true
        27:    action(windows? ? :install : :upgrade)
        28:  end
        29:
        30:  omnibus_env['OMNIBUS_TOOLCHAIN_INSTALL_DIR'] << toolchain_install_dir
        31:  omnibus_env['SSL_CERT_FILE'] << windows_safe_path_join(toolchain_install_dir, 'embedded', 'ssl', 'certs', 'cacert.pem')

       System Info:
       ------------
       chef_version=17.0.242
       platform=ubuntu
       platform_version=18.04
       ruby=ruby 3.0.1p64 (2021-04-05 revision 0fb782ee38) [x86_64-linux]
       program_name=/opt/chef/bin/chef-client
       executable=/opt/chef/bin/chef-client

       Running handlers:
       [2021-05-03T20:44:21+00:00] ERROR: Running exception handlers
       Running handlers complete
       [2021-05-03T20:44:21+00:00] ERROR: Exception handlers complete
       Chef Infra Client failed. 0 resources updated in 03 seconds

Acceptance criteria:
Dev is able to build omnibus packages locally.

We probably want to remove the omnibus cookbook which isn't maintained anymore and instead use the omnibus-toolchain like our builders/testers do

I needed to upgrade the versions of the software involved to get this working.

This was fixed in https://github.com/chef/chef-server/pull/3149


Using build to build the sdist and wheel files

The latest CI failures seem to stem from the setup.cfg of the backend - Celery and its transitory dependencies install fine but every top-level dep after celery here is not installed. Looks like the indentation is off.
Other than that - I think we shouldn't pin these dependencies so tightly like this, because then we run into what is discussed in https://github.com/abnamro/repository-scanner/pull/181. But we can open a separate issue to tackle that if you prefer (I envisage it to end up like the setup.cfg/setup.py of the wizard where a range of versions are acceptable and not one specific version for each dependency - which makes it more difficult to install other packages in the same environment as resc (which have their own dependency requirements).

FYI added https://github.com/abnamro/repository-scanner/issues/201 so we can separate the version-pinning refactor into a different PR.

This should also fix/close #181 btw.


review first pass of freshdata api documentation

@jhammock as discussed, please solicit reviews to the first pass at the api documentation here: https://github.com/gimmefreshdata/freshdata/wiki/api . Please feel free to edit/update in the wiki (anyone can edit). This api should be able to cover the fresh data use cases.

This looks great! It was human readable, even for @jhammock. I would like to reach out to a couple of partners (data provider, data consumer, and EOL integrator) for review. OK to proceed?
(I know we're still waiting on the queries-of-subscribed-records layer, but I think this is enough to be starting with for everyone- yes?)

@jhammock would be great to get a first pass at the reviews from partners. I'd be particularly interested how they'd like to get notified of changes, particularly in the server-to-server communication).


Loss of DF multi-index when joining a DF without multi-index

Hi,
I am seeing a multi-index DF lose its multi-index (goes to 0,1,2,3...) when doing a left join with a DF without a multi-index.  Is that the expected behavior?

[7] pry(#<Nemawashi::Analytics::Transforms::Update>)> dataobj.index
=> #<Daru::Index(30): {0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19 ... 29}>
[8] pry(#<Nemawashi::Analytics::Transforms::Update>)> updated_dataframe = @source.data.join(dataobj, how: :left, on: match_columns)
[9] pry(#<Nemawashi::Analytics::Transforms::Update>)> updated_dataframe.index
=> #<Daru::Index(26): {0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19 ... 25}>

thx

I believe it is a bug, but can you please provide a self-containing example for easier reproduction?

@zverok sorry for the delay, will get to this today.

OK here we go:
[1] pry(#<Nemawashi::Analytics::Transforms::Update>)> @source.data
=> #<Daru::DataFrame(4x7)>
                unit testA_ft1 testA_ws1 testB_ft1 testB_ws1 testC_ft1 testC_ws1
         1         1       nil       0.0       nil       0.0       nil       1.0
         2         2       0.0       nil       1.0       nil       0.0       nil
         3         3       nil       0.0       nil       0.0       nil       1.0
         4         4       0.0       nil       1.0       nil       0.0       nil
[2] pry(#<Nemawashi::Analytics::Transforms::Update>)> dataobj
=> #<Daru::DataFrame(4x4)>
                unit testA_ws1 testD_ws1 testE_ws1
         1         1       1.0       0.0       1.0
         2         2       0.0       1.0       0.0
         3         3       1.0       1.0       0.0
         4         4       0.0       1.0       0.0
[3] pry(#<Nemawashi::Analytics::Transforms::Update>)> @source.data.index
=> #<Daru::MultiIndex(4x1)>
   1
   2
   3
   4
[4] pry(#<Nemawashi::Analytics::Transforms::Update>)> dataobj.index
=> #<Daru::MultiIndex(4x1)>
   1
   2
   3
   4
[5] pry(#<Nemawashi::Analytics::Transforms::Update>)> updated_dataframe = @source.data.join(dataobj, how: :left, on: match_columns)
=> #<Daru::DataFrame(4x10)>
             testA_ft1 testA_ws1_  testB_ft1  testB_ws1  testC_ft1  testC_ws1       unit testA_ws1_  testD_ws1  testE_ws1
          0        nil        0.0        nil        0.0        nil        1.0          1        1.0        0.0        1.0
          1        0.0        nil        1.0        nil        0.0        nil          2        0.0        1.0        0.0
          2        nil        0.0        nil        0.0        nil        1.0          3        1.0        1.0        0.0
          3        0.0        nil        1.0        nil        0.0        nil          4        0.0        1.0        0.0
[6] pry(#<Nemawashi::Analytics::Transforms::Update>)> updated_dataframe.index
=> #<Daru::Index(4): {0, 1, 2, 3}>

In reality, it seems like any join between a multiindex DF and any type of indexed DF results in a Daru::Index DF.  I believe this is related to the merge issue.

Please check if it works on current master should be solved by #431

@zverok I am still seeing the join method turn 2 DFs with multiindex into a single index but my example perhaps is not the best due to the fact that it looks like daru is actually 'optimizing' away the multi-index.
[1] pry(#<Nemawashi::Analytics::Transforms::Update>)> @source.data.index.to_a
=> [[1], [2], [3], [4]]
[2] pry(#<Nemawashi::Analytics::Transforms::Update>)> dataobj.index.to_a
=> [[1], [2], [3], [4]]
[3] pry(#<Nemawashi::Analytics::Transforms::Update>)>
    60:           binding.pry
    61:           updated_dataframe = @source.data.join(dataobj, how: :left, on: match_columns)
 => 62:           binding.pry
[2] pry(#<Nemawashi::Analytics::Transforms::Update>)> updated_dataframe.index.to_a
=> [0, 1, 2, 3]

Is this intended behavior?  I will try to find a better example where the pre-join index cannot be flattened to be the same as the post-join index.

Well, in fact, currently:

join does NOT preserve index (because in general case, two joined dataframes can have different indexes, how'd you preserve them?)
...and just provides "default" index.

I have a suspicion that the most reasonable behavior would be "make join columns an index", but not sure it should/would/can work (see "duplicate index discussion" here ;)).
Anyways, I am pretty sure your initial request (preserving index of both dataframes on join) can't be performed. Why do you believe otherwise?

@zverok if two dataframes have the same index shouldn't the index be preserved?

But why it should?
Logically, "joining" is merging of different data sources: people (indexed by name) join departments (indexed by id), books (indexed by isbn) join authors (indexed by name)...
What is the real-life use case for two dataframes that should be joined, but have the same index?

@zverok so let's say my multi-index is [:work_week, :factory] and i pull yield data from one database and I pull volume forecast data from another database that uses the same multi-index of [:work_week, :factory] and want them to be joined.  why should I lose the matching multi-index on the subsequently created dataframe?

By which column you join them, then?

those 2 columns.

So, you join them on index?


Defining a folder to scan and create a MD5 list before starting a download

I'm using the grabber to collect a few images form selected characters from different franchises.
filename currently is charactername/rating/charactername+md5+ext
The problem I like to sort my images in a specific way.
This means I'm adding a number of subdirectories and sort the images based on them.
Which basically means I get duplicates.
And I did run a fair number of tests.
I did set it to "Don't save" for globally and same directory.
I also did rescan all MD5s a multiple times.
Describe the solution you'd like
To the fact that I'm using the tool for 5 days now and I may not have clearly understood its features, so I'm suggesting a feature not reporting a bug.
When I start a download - may it be a "Get All" or "Monitor" I want to define a folder to scan and recalculate the MD5 of all files in all subdirectories and uses this for the download.
Let's downloaded all images of Bluma. Then by my filename above, I will have a subdirectory with the name "Bulma" in my Download folder.
And that directory with the name "Bluma" is the one I define to be scanned before the download.
If it goes through all subdirectories of Bulma and checks the MD5 list which will be created with the to be downloaded images - it should greatly reduce the duplicates and I still can sort.
Describe alternatives you've considered
I tried anything I could think of based on the documentation.
I also considered opening an issue type bug as I have the feeling that it just checks the file path and not a saved list of md5.
Because As I change my filename to not include the rating and hit on all download again - it actually ignores the existing files. If I create a folder named "test" and do the same after moving one image into that folder - it will download only the image I put in the "test" folder.

If you move the file outside of grabber (not using the rename existing image tool), you should check the option "keep deleted files in the MD5 list" on the "Save" option into the option menu, it'll force grabber to remember that you have already downloaded the image, even if you have moved or deleted it.

That more or less only solves it partly or can be counted as a workaround.
I still think an optional specific scan before would reduce the duplicates greatly when downloading a bulk or when using the monitor.

This is actual problem


After reboot topolvm-node container, online expand pvc doesn't work.

Describe the bug
Hi, I'm a new user of TopoLVM, my K8S version is 1.14, so I just follow the guide install the topolvm(0.4.0). it works fine at the begging, but I find a bug soon.
After I reboot the node-xxxx POD, exactly the topolvm-node container, online expand pvc doesn't work, everything stuck.
POD stuck in such message:
Warning  VolumeResizeFailed          2m36s (x19 over 25m)  kubelet, kpdbw03  VolumeFSResize.resizeFileSystem failed for volume "pvc-50a80e4d-7cba-11eb-935e-f4deaf2c811a" : MountVolume.resizeFileSystem failed : Expander.NodeExpanr: code = Internal desc = failed to detect filesystem of /dev/topolvm/50b12f57-7cba-11eb-9666-f4deaf2c80f0: open /dev/topolvm/50b12f57-7cba-11eb-9666-f4deaf2c80f0: no such file or directory
PVC stuck in thins：
FileSystemResizePending   True    Mon, 01 Jan 0001 00:00:00 +0000   Mon, 08 Mar 2021 15:57:41 +0800           Waiting for user to (re-)start a pod to finish file system resize of volume on node.
Event is:
Normal     Resizing                  12s (x2 over 102m)   external-resizer topolvm.cybozu.com  External resizer is resizing volume pvc-50a80e4d-7cba-11eb-935e-f4deaf2c811a
Normal     FileSystemResizeRequired  10s (x2 over 102m)   external-resizer topolvm.cybozu.com  Require file system resize of volume on node
Warning    ExternalExpanding         70s (x8 over 27m)     volume_expand                        Ignoring the PVC: didn't find a plugin capable of expanding the volume; waiting for an external controller to process this PVC.
Mounted By:  kylin-statefulset-two-1
PV has expanded successfully，you can find that in the worker node，it's already expanded. but PVC can not.
there are 2 ways to solve this problem:
1.restart the app POD and it works find. but it's not ONLINE EXPAND.
2,umount filesystem in worker node, like this:
umount /var/lib/kubelet/pods/12f86edd-7fd5-11eb-8f73-f4deaf2c811a/volumes/kubernetes.io~csi/pvc-50a80e4d-7cba-11eb-935e-f4deaf2c811a/mount
THEN restart kubelet of this worker node, it works too. but it's not safe, it's dangerous.
WHY AFTER REBOOT THE TOPOLVM-NODE CONTAINER, ONLINE EXPAND DOES NOT WORK???
Environments

Version: 0.4.0/0.6.0
OS: Centos 8.1

To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Additional context
Add any other context about the problem here.

Duplicate of #143 and fixed in #144.


ReadOnly does not alter custom blocks editability

Do you want to request a feature or report a bug?
feature
What is the current behavior?
when I set ReadOnly for editor the custom blocks are still editables
What is the expected behavior?
I would expect that all the components in the editor change their contenteditable from the Editor readOnly prop
Which versions of Draft.js, and which browser / OS are affected by this issue? Did this work in previous versions of Draft.js?
version 0.9.1 , tested on osx chrome 54

well , I've managed this calling EditorState.createWithContent(new_content, @decorator) after ReadOnly state is updated


Vulnerability roundup 112: nats-server-2.6.0: 1 advisory [6.5]

search, files

[ ] CVE-2022-26652 CVSSv3=6.5 (nixos-21.11)

CVE details
CVE-2022-26652
NATS nats-server before 2.7.4 allows Directory Traversal (with write access) via an element in a ZIP archive for JetStream streams. nats-streaming-server before 0.24.3 is also affected.

Scanned versions: nixos-21.11: efea022d6fe.
Cc @swdunlop

See also: #160685

#164173


Add mapbox-matrix

As a follow up to the release of mapbox 0.15.

Separating the removal of Distances API as an immediate priority - see #118

Stale.


play back lag when playing from iheart radio, and too much CPU loading

IMPORTANT: Before you create an issue, please take a look at our Issue Reporting Guide.
Briefly summarize your issue:
play back lag when playing from iheart radio, and additionally, thread src:src (looks like thread from gstreamer for appsrc) consumes too much CPU.
What is the expected behavior?
play back should be smoothly, and consume the same level CPU resource comparing with Amazon music.
What behavior are you observing?
the playback lags on each ~10-15 seconds, we see frequent buffering, under run,  and we see thread "src:src" consumes one of our CPU core. this is twice higher loading than playing from amazon music. even I move "src:src" onto an idle thread.
while when playing amazon music, everything goes OK.  the thread "src:src" takes only 1/3 of one CPU thread. this is also 1/3 comparing with iheart radio.
Provide the steps to reproduce the issue, if applicable:
just ask "alexa, play iheart radio".
Tell us about your environment:

What version of the AVS Device SDK are you using?
  v1.17.0

testing under a 500Mbps broadband line.
Tell us what hardware you're using:

[ ] Desktop / Laptop
[ ] Raspberry Pi
[X] Other - tell us more: MIPS CPU with 2 core 4 thread 900Mhz.

Tell us about your OS (Type & version):

[X] Linux
[ ] MacOS
[ ] Raspbian Stretch
[ ] Raspbian Jessy
[ ] Other - tell us more:

I attach more logs and screen shots for your reference. please help.

and detail logs under playback
log_level_9.log

more information to share:

using Echo Dot3 to play iheart radio under the same line,  everything OK.
using an ububtu 16.04 PC to play iheart radio by running AVS SDK v1.17, everything OK.

Hello @zixu-suzhou thanks for posting.
Unfortunately it will be difficult to debug exactly why you are seeing a CPU usage increase since you are using a platform outside of our supported platforms.
iHeartRadio plays differently from Amazon Music as it sends one media url instead of a playlist url like Amazon Music.

Closing due to inactivity. Please open a new issue if this continues to be a problem, or if you have other questions. Thanks!


bug: deno deploy from URL fails

Good morning fellow Denozins! This is an issue I've been running into for quite a while now, sorry for not reporting it earlier.
I'm unable to deploy from a URL (or remote git repository) to Deno Deploy. This happens for me on any project that consists of anything more than one file. Importing from deps.ts? or a src or lib folder? Not gonna happen. This is the same regardless of whether I use the ?url= parameter on the /new page, or if I select a git repository from my own account / orgs in the drop down (unless, as stated, it's only a main.tsx file I'm trying to deploy).
For example, on the docland landing page, theres a link that indicates a user can "deploy their own" version of it by simply clicking that link. Sweet, sounds like a plan. Except it never succeeds.
I made a quick video to demonstrate the unexpected behavior (see below). I'm no expert on the matter but it seems like an issue with import maps or resolving relative imports within the source project.

My two cents on the impact: This could present itself to be a major roadblock for onboarding new users, as many users will simply move on to something else when encountering something like this.

https://user-images.githubusercontent.com/11234104/185675285-b32de1ab-26b2-4f2e-8268-d7f726793864.mov

Pretty sure I just created this issue in the wrong location, since it's technically not on deno.land. Sorry about that guys 😬 If you could point me in the right direction to file issues like this, I'd be much obliged.

https://github.com/denoland/deploy_feedback/issues/new


CurrentImage height

I'm submitting a...

[ ] Regression (a behavior that used to work and stopped working in a new release)
[ ] Bug report
[ ] Feature request
[x] Documentation issue or request
[ ] Support request

Current behavior

Hi.
Great module!
I would like to ask you something since I'm not able to find it in the docs.
As I understand  from:
angular-modal-gallery/libs/angular-modal-gallery/src/components/current-image/current-image.scss ->
$curr-img-max-height: 60vh;
the current height of the image inside the modal is 60% of the screen height.

Otherwise, the image become quite small.
Is there any way to configure it?
If not, would be possible to override it in my component?
I've tried overriding #current-image in my component's .css but unfortunately this trick didn't work.
Expected behavior

It would be nice to be able to control this value from configuration.
or
If possible, add to documentation how to override it.
Minimal reproduction of the problem with instructions

My official live example on StackBlitz (based on https://stackblitz.com/edit/angular-modal-gallery-v5) is:
What is the motivation / use case for changing the behavior?

I'm currently using this module
Environment (the most important section to fill very carefully)

- Node version: 8.2.1
- npm version: 5.3.0
- Operating System and version:  Windows 10
- Angular version: 5.2.9
- angular-cli version (or SystemJS/Webpack): 1.6.2
- I'm using Server Side Rendering with angular-universal: NO
- I'm compiling with mode: DEBUG

Browser:
- [x] Chrome (desktop) version XX
- [ ] Chrome (Android) version XX
- [ ] Chrome (iOS) version XX
- [ ] Firefox version XX
- [ ] Safari (desktop) version XX
- [ ] Safari (iOS) version XX
- [ ] IE version XX
- [ ] Edge version XX

Others:

Hi.
I decided to use 80 to fully support all browsers (in particular Ie11). It was a good value to prevent issues, so I don't recommend to change it if you want to support also edge and ie11. However, it should be possibile to change it. I'll check this evening because I don't have my laptop right now :)

I tried and it's working.
I added this to my main styles.scss
#current-image {
  max-height: 80vh !important;
  max-width: 80vh !important;
  height: auto !important;
}

Obviously change values as you prefer.
However, be careful on IE11 and Edge. If you want to support all browsers, test all of them, also resizing the window both vertically and horizontally.

Hi,
It works for me too.
Thanks.
It sucks though that it only works in the main style file.
I prefer to keep styles related to a particular component in the local component .css

I schedule this issue to investigate and try to find a way to add an input param to choose this value.

@Ks89 Guys, sorry but I couldn't find the zooming for desktop functionality, how can I zoom the pictures? The size is too small, it's better to have an ability for zooming, thanks

@javasmaster I don't understand, please could you post a screenshot of your application with the "small" image?


sum-of-digits(c and java)

Why:
closes #38
closes #178
Check off the following:

[x] I have reviewed my changes in staging (look for "Automatically generated comment" and click Modified to view your latest changes).
[x] For content changes, I have completed the self-review checklist.

Hey @debaghosh
Thanks for your continuous contribution to this project 😃
This PR will be reviewed and merged shortly.

Preview : https://codinasion--pr18-dev-5o7hj3iz.web.app/programme/sum-of-digits/

LIVE : https://codinasion.web.app/programme/sum-of-digits/


Avoid setting nil backtraces in rpc errors

Fixes #1997

I don't think overriding the standard Exception#backtrace with an empty array makes any sense either.
The server/agent RpcServer::Error is only used for local exceptions raised by the local handlers... There is no reason for it to take a backtrace as an argument?
The server/agent RpcClient::Error is raised for remote error responses, and the backtrace contains the backtrace from the remote side. IMO storing this as an attr named backtrace is a bug, as it overrides the standard Exception#backtrace that contains the local backtrace (which method did the RPC request). It should be called something like the remote_backtrace instead?

Tested to fix #1997
E, [2017-03-17T11:40:17.666636 #22268] ERROR -- GridServiceInstanceDeployer: failed to deploy service instance development/null/redis-1 to node core-01
E, [2017-03-17T11:40:17.666900 #22268] ERROR -- GridServiceInstanceDeployer: Connection timeout (2s)
E, [2017-03-17T11:40:17.667174 #22268] ERROR -- GridServiceInstanceDeployer: /home/kontena/kontena/kontena/server/app/services/rpc_client.rb:79:in `wait_for_response'
/home/kontena/kontena/kontena/server/app/services/rpc_client.rb:42:in `request'
/home/kontena/kontena/kontena/server/app/services/docker/service_creator.rb:80:in `request_create_service'
/home/kontena/kontena/kontena/server/app/services/docker/service_creator.rb:21:in `create_service_instance'
/home/kontena/kontena/kontena/server/app/services/grid_service_instance_deployer.rb:55:in `create_service_instance'
/home/kontena/kontena/kontena/server/app/services/grid_service_instance_deployer.rb:20:in `deploy'
/home/kontena/kontena/kontena/server/app/services/grid_service_deployer.rb:111:in `block in deploy_service_instance'
/home/kontena/kontena/kontena/server/vendor/bundle/ruby/2.3.0/gems/celluloid-0.17.3/lib/celluloid/calls.rb:28:in `public_send'
/home/kontena/kontena/kontena/server/vendor/bundle/ruby/2.3.0/gems/celluloid-0.17.3/lib/celluloid/calls.rb:28:in `dispatch'
/home/kontena/kontena/kontena/server/vendor/bundle/ruby/2.3.0/gems/celluloid-0.17.3/lib/celluloid/call/sync.rb:16:in `dispatch'
/home/kontena/kontena/kontena/server/vendor/bundle/ruby/2.3.0/gems/celluloid-0.17.3/lib/celluloid/future.rb:18:in `block in new'
/home/kontena/kontena/kontena/server/vendor/bundle/ruby/2.3.0/gems/celluloid-essentials-0.20.5/lib/celluloid/internals/thread_handle.rb:14:in `block in initialize'
/home/kontena/kontena/kontena/server/vendor/bundle/ruby/2.3.0/gems/celluloid-0.17.3/lib/celluloid/actor/system.rb:78:in `block in get_thread'
/home/kontena/kontena/kontena/server/vendor/bundle/ruby/2.3.0/gems/celluloid-0.17.3/lib/celluloid/group/spawner.rb:50:in `block in instantiate'

Ping @kke
Do we keep this Exception#initialize @caller = caller thing, or can we get rid of it?

Well the idea was to avoid setting nil backtraces. Of course it could do super || [] if we are not interested where the local exception was created.

Seems there's definitely some weirdness going on when overriding the Exception#backtrace:

super seems to always return nil ()
ruby calls it implicitly while raising, well before anything else even tries to rescue it
regardless of when raising with new or comma?

irb(main):002:0> def foo
irb(main):003:1>   raise RpcClient::TimeoutError.new(503, "Connection timeout (1s)")
irb(main):004:1> end
=> :foo
irb(main):005:0>
irb(main):006:0* foo()
NoMethodError: undefined method `+' for nil:NilClass
	from /home/kontena/kontena/kontena/server/app/services/rpc_client.rb:15:in `backtrace'
	from (irb):3:in `foo'
	from (irb):6
	from /usr/bin/irb:11:in `<top (required)>'

irb(main):007:0> def foo
irb(main):008:1>   raise RpcClient::TimeoutError.new(503, "Connection timeout (1s)")
irb(main):009:1> rescue => error
irb(main):010:1>   $stderr.puts("failed: #{error}")
irb(main):011:1> end
=> :foo
irb(main):012:0>
irb(main):013:0* foo()
failed: undefined method `+' for nil:NilClass
=> nil

Even with super || [], the backtrace is just empty:
irb(main):002:0> def foo
irb(main):003:1>   raise RpcClient::TimeoutError.new(503, "Connection timeout (1s)")
irb(main):004:1> end
=> :foo
irb(main):005:0>
irb(main):006:0* foo()
RpcClient::TimeoutError: Connection timeout (1s)
irb(main):007:0>

So it doesn't seem like the approach of overriding the def backtrace works...

There's set_backtrace method in exception but maybe the approach is wrong to begin with.

The def backtrace -> Array(super) + Array(remote_backtrace) approach seems to result in the local backtrace always being missing.

Travis failures are in the agent observable specs, ignoring.


Updated the menu so it refers to the blocks of the webpage

This should close issue #5
Happy Hacktoberfest everyone!

Happy belated Hacktoberfest to you too!
Thank you for the PR! I think we should add another "block" to not lose the links in the current menu, perhaps in #help?

True, accepted