[question] Use cycles instead of ref-cycles

What happened:
Use ref-cycles as CPI factor.
What you expected to happen:
Use cycles as CPI factor.
Environment:

Koordinator version: - v0.6.2
Kubernetes version (use kubectl version): v1.22.5
docker/containerd version: containerd 1.5.0
OS (e.g: cat /etc/os-release): Ubuntu 20.04.4 LTS
Kernel (e.g. uname -a): Linux 5.10.112-11.al8.x86_64 #1 SMP Tue May 24 16:05:50 CST 2022 x86_64 x86_64 x86_64 GNU/Linux

Anything else we need to know:
CPI is typically measured in cycles rather than ref-cycles as a performance evaluation metric.
References:

https://www.brendangregg.com/blog/2014-10-31/cpi-flame-graphs.html
https://www.intel.com/content/www/us/en/docs/vtune-profiler/user-guide/2023-0/cpu-metrics-reference.html

/area koordlet
/cc @songtao98

@Rouzip Sorry for being late to answer.
When CPI collector is implemented in koordlet, the reference is CPI2 : CPU performance isolation for shared compute clusters It was clarified in Chapter 3.1 as CPI data is derived from hardware counters,
and is defined as the value of the CPU CLK UNHALTED.REF
counter divided by the INSTRUCTIONS RETIRED counter.
Besides, personally speaking, the CPU CLK UNHALTED.REF is not affected by thread frequency changes(CPU's dynamic frequency scaling mechanism). So I'll prefer this one but also want to hear more ideas from you.
/cc @saintube @zwzhang0107

But the retired instructions in constant time doesn't reflect the performance of the application. Under the influence of similar technologies such as Intel SST, the calculation of CPI by the existing algorithm will lead to different results under different frequencies of the same machine, but it does not reflect the corresponding change in the performance of the application. @songtao98 @saintube

Can you explain the difference between these two conters in detail, what is the calculation logic of these two indicators inside the CPU when the frequency changes?

But the retired instructions in constant time doesn't reflect the performance of the application. Under the influence of similar technologies such as Intel SST, the calculation of CPI by the existing algorithm will lead to different results under different frequencies of the same machine, but it does not reflect the corresponding change in the performance of the application. @songtao98 @saintube

Can you explain the difference between these two conters in detail, what is the calculation logic of these two indicators inside the CPU when the frequency changes?

As mentioned by @songtao98 , ref-cycles do not vary based on CPU frequency and can be considered a constant value within a certain period of time. On the other hand, cycles do vary with CPU frequency. Assuming a change in CPU frequency while the program itself remains unchanged, this variation in CPU frequency within the original calculation formula would cause CPI to change. Consequently, it would fail to accurately reflect the scenario where the program itself has not changed. If I have made any mistakes, please help me identify them. Thank you.

@Rouzip Actually, there are two types of workloads. Let's just say Web Service and Batch Job. They have different characters on loads within a fixed time periods.
Web Service has a stable QPS, which means a (almost)fixed number of instructions to execute in 10s.
Batch Job is a CPU hungerer, which means it has infinite instructions to execute as long as there are enough CPU cycles in 10s.
If we just limit the scope on CPU frequency.
For Web Service, both ref-cycle and instruction number will keep the same.
For Batch Job, ref-cycle keeps the same but the instruction number will grow if CPU has higher frequency.
So, maybe
If we want to measure whether the Web Service got interference, we should use ref-cycle/instructions as a metric.
If we want to measure the performance of Batch Job, we should use MIPS as a metric.

Beside, can we use the ref-cycles counter for calculating the normalized cpu utilization?

Sorry for the late response. After conducting some experiments, I have found that both cycles and ref-cycles can demonstrate program performance changes. Therefore, read-world experiments may be necessary to determine which metrics produces more accurate result.
However there is a flaw in your code. When calculating CPI using perf_event_open, it is crucial to count ref-cycles and instructions from the same perf group, or time-multiplexed PMU will make a wrong result.

Beside, can we use the ref-cycles counter for calculating the normalized cpu utilization?

I think cycles is better.

As mentioned by @songtao98 , ref-cycles do not vary based on CPU frequency and can be considered a constant value within a certain period of time. On the other hand, cycles do vary with CPU frequency. Assuming a change in CPU frequency while the program itself remains unchanged, this variation in CPU frequency within the original calculation formula would cause CPI to change. Consequently, it would fail to accurately reflect the scenario where the program itself has not changed. If I have made any mistakes, please help me identify them. Thank you.

This is a very interesting question worth discussing. Assume a scenario where Pod A executes instructions that consume memory bandwidth (for example, occupying 50% of the memory access bandwidth), which affects the memory access efficiency of Pod B, causing the latency of Pod B to drop by 10%. If the CPU where Pod B resides increases the operating frequency by 15% due to the turbo mechanism, finally considering the combined impact of frequency and memory access, the performance of Pod B remains the same.
In this scenario, Pod B is observed. Cycles has nothing to do with frequency, so we will see a significant increase (due to the impact of Pod A). The increase and decrease of ref-cycles is not clear, because it is affected by the combined impact of memory access efficiency and frequency improvement?

/reopen

From the experimental point of view, ref-cycles are not affected by frequency, and cycles are affected by frequency. The larger the turbo frequency, the larger the cycles, which is anti-correlated with the semantics of the CPI response. It seems that ref-cycles is more suitable here. @Rouzip

/reopen

From the experimental point of view, ref-cycles are not affected by frequency, and cycles are affected by frequency. The larger the turbo frequency, the larger the cycles, which is anti-correlated with the semantics of the CPI response. It seems that ref-cycles is more suitable here. @Rouzip

Good job! However, the CPI collected by koordinator may not be accurate at present, and perf needs to be used to collect it.

@Rouzip Sorry for being late to answer.
When CPI collector is implemented in koordlet, the reference is CPI2 : CPU performance isolation for shared compute clusters It was clarified in Chapter 3.1 as CPI data is derived from hardware counters, and is defined as the value of the CPU CLK UNHALTED.REF counter divided by the INSTRUCTIONS RETIRED counter.
Besides, personally speaking, the CPU CLK UNHALTED.REF is not affected by thread frequency changes(CPU's dynamic frequency scaling mechanism). So I'll prefer this one but also want to hear more ideas from you.
/cc @saintube @zwzhang0107

In this paper, they use CPI as a symptom, and they get this conclusion by statistical method. So if we want to carefully analyze the underlying reasons reflected by CPI changes (whether it is cycles or ref-cycles), more research is needed.

Beside, can we use the ref-cycles counter for calculating the normalized cpu utilization?

Beside, can we use the ref-cycles counter for calculating the normalized cpu utilization?

Sorry for the wrong answer, we should use ref-cycles to calculate CPU utilization.(In emon)

Thanks for the great job! @hormes

Good job! However, the CPI collected by koordinator may not be accurate at present, and perf needs to be used to collect it.

So the conclusion is your PR #1489 can fix this problem with solving PMU multiplexing.

Sorry for the wrong answer, we should use ref-cycles to calculate CPU utilization.(In emon)

And #1482 should be aborted for using Cycles?

In this paper, they use CPI as a symptom, and they get this conclusion by statistical method. So if we want to carefully analyze the underlying reasons reflected by CPI changes (whether it is cycles or ref-cycles), more research is needed.

And for this, we will work more for better analyzing.
@hormes @Rouzip

The larger the turbo frequency, the larger the cycles, which is anti-correlated with the semantics of the CPI response.

I made a mistake here. In fact, the relationship between the two is accurately described by this equation:
$\frac{cycles}{freq} = time = \frac{ref cycles}{base freq}$
Cycles are positively correlated with frequency, and ultimately CPI is positively correlated with frequency, not anticorrelated.
Assuming that the frequency remains unchanged, the direct effect of the program being interfered is to slow down, that is, to run longer time, that is, both cycles and ref cycles can express this result. Therefore, when discussing this issue, the main concern is the situation of frequency change.
For the same QPS online process, when a machine runs at 2.0G main frequency, its cycles are X, and for the same CPU model, when the frequency is 3.0G, the cycles are still X, that is, if the CPI is calculated by cycles, the two CPI for the case is the same, but obviously, the latency seen by the service on the two nodes is different.

Thanks for the great job! @hormes

Good job! However, the CPI collected by koordinator may not be accurate at present, and perf needs to be used to collect it.

So the conclusion is your PR #1489 can fix this problem with solving PMU multiplexing.

Sorry for the wrong answer, we should use ref-cycles to calculate CPU utilization.(In emon)

And #1482 should be aborted for using Cycles?

In this paper, they use CPI as a symptom, and they get this conclusion by statistical method. So if we want to carefully analyze the underlying reasons reflected by CPI changes (whether it is cycles or ref-cycles), more research is needed.

And for this, we will work more for better analyzing.
@hormes @Rouzip

I will issue another pr to fix perf group problem, #1489  is not enough.


Remove exceptions printing stack traces

At various places in the CQL libraries Exceptions are caught and stack traces are printed such as here:
https://github.com/cqframework/clinical_quality_language/blob/master/Src/java/quick/src/main/java/org/cqframework/cql/cql2elm/quick/FhirModelInfoProvider.java#L69
For a core library included in other components, this bypasses whatever other logging mechanisms may be in place (such as slf4j, log4j, etc) and prints directly to the std error output stream. This means some diagnostic logging may be lost, and it also pollutes the output stream in cases where that's not desirable. For example, with the use of CLI tools.
We should remove all instances of Exception::printStackTrace() and either rethrow exceptions, log via a logging API, or ignore as appropriately.
The one exception to that rule is in the case where we're intentionally building a CLI.

second exception to the rule: Test code. :)


Error: Command failed: gradlew.bat app:installDebug -PreactNativeDevServerPort=8081

Hi
i am new to react native,just a beginner. am unable to build my project after installing dependency
npm-install-react-native-video.its showing below errors. in my previous project it was working fine,
i have autolinked as well. my project version details are mentioned below.
is this npm deprecated. if i uninstall this npm its building fine.
pls someone help me,am strugglind for the last 2 weeks due to this.

Task :app:checkDebugAarMetadata FAILED
error Failed to install the app. Make sure you have the Android development environment set up: https://reactnative.dev/docs/environment-setup.

Error: Command failed: gradlew.bat app:installDebug -PreactNativeDevServerPort=8081
Execution failed for task ':app:checkDebugAarMetadata'.
"dependencies": {
"react": "17.0.2",
"react-native": "0.65.1",
"react-native-video": "^5.1.1",
"react-native-video-controls": "^2.8.1"
},
App.js:
import React from 'react';
import {View,Text} from 'react-native';
import VideoPlayer from 'react-native-video-controls';
import Video from 'react-native-video';
const Video =()=>{
return(
<View style={{flex:1,alignItems:'center',justifyContent:'center'}}>
<Video
source={{uri:'https://www.w3schools.com/html/mov_bbb.mp4'}}
/>

)
}
export default Video;

can anyone help me out of this issue?

In RN 0.65, jcenter() in Android was deleted.
Add it back to app/build.gradle
Solution from #2462.


Cake.Powershell v0.4.0 not compatible with Cake v0.21.1

It appears that Cake dlls using .NET v4.5 (i.e. in Cake v0.21.1) are not supported after targeting .NET v4.61 as part of commit a207a0c0d99b854df162edd12a1b02fba80e8eb7.
Error reported in PS when running default task that uses #addin "Cake.Powershell" is:
Preparing to run build script...
Running build script...
Analyzing build script...
Processing build script...
Installing addins...
Could not find any assemblies compatible with .NETFramework,Version=v4.5.
Error: Failed to install addin 'Cake.Powershell'.

A temporary workaround is to explicitly target v0.3.5 e.g. #addin "Cake.Powershell&version=0.3.5" .
We need to pin to Cake v0.21.1 due to other addins not yet supporting v0.22.0 so we cannot use Cake.Powershell v0.4.0 at this stage.

Correct the solution is to pin Cake.Powershell to a lower version. No need to create an issue about that though 😜

Cheers for the fast response!

Had a second tab open at the time.
Breaking changes are never cool but I didn't create them, I'm just trying to keep up with Cake 😉
net461 makes sense if you look at the compatibility matrix for net standard, so I can't blame them for upgrading it as arguably everyone that was on net45 should be able to install net461.


Add properties in Info.plist for iOS in ExampleApp

NSMicrophoneUsageDescription is necessary for testing on actual device. This is not required for running on iOS simulator.
UIBackgroundModes is the only required fields for background play in iOS according to our investigation. I think this field is better to set to be true for ExampleApp because lots of RN developer might be curious if this library can play audio in background.

Thanks! Can you also document this in the README?

Nevermind, you have a separate PR for that :-)


Two potential deadlocks in evm

Component
Foundryup
Have you ensured that all of these are up to date?

[X] Foundry
[X] Foundryup

What version of Foundry are you on?
No response
What command(s) is the bug in?
No response
Operating System
No response
Describe the bug

ConflictLock
https://github.com/foundry-rs/foundry/blob/5577fcb7d92ef4f3bdb81544e1ed1e6cb402fa86/evm/src/executor/fork/cache.rs#L181-L183
https://github.com/foundry-rs/foundry/blob/5577fcb7d92ef4f3bdb81544e1ed1e6cb402fa86/evm/src/executor/fork/cache.rs#L219-L222
The lock orders of storage and accounts conflict between do_commit and clone. When interleaved as the table, a deadlock will happen.

DoubleLock
arc_state: parking_lot::RwLock<...>
https://github.com/foundry-rs/foundry/blob/5577fcb7d92ef4f3bdb81544e1ed1e6cb402fa86/evm/src/fuzz/strategies/param.rs#L58-L67
The two locks are on L60 and L67.
There is a double read lock on arc_state in fuzz_param_from_state, if interleaved by a write from another thread, then a deadlock will happen.

nice find, tysm!


Cleaned Profile Module from Dart warnings

Follow issue here :
#52

@ammaratef45/z please, pay attention to this pull request

@Bahaaib thanks, the ci is broken because of problem with python in the docker image so I will merge this manually till we solve it.
Please check if you can help with it.

Okay. thanks!

Job #53 is now in scope, role is REV

Job gh:ammaratef45/attendance#53 is not assigned, can't get performer

The job #53 is now out of scope


[FEATURE] StreamClass-based contracts

The streaming plugins and the stream operator utilize a specific set of entities that must be consistent across both applications. These include:

The value of schema mismatch annotation
The structure of the stream status resource

These aspects are planned to be updated in future versions of Arcane Operator as follows:

The Stream class resource will incorporate additional fields that provide a description of the schema mismatch reporting mechanism.
The Stream class resource will include extra fields that explain the structure of the stream status resource.

Also if the stream plugin cannot run in backfill mode, it should be defined in StreamClass.

Also, stream class should provide configuration for retries (see: #124)


fix: hcc position

Codecov Report
Base: 86.28% // Head: 86.25% // Decreases project coverage by -0.04% :warning:

Coverage data is based on head (abcee5e) compared to base (2681ad1).
Patch coverage: 50.00% of modified lines in pull request are covered.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #322      +/-   ##
==========================================
- Coverage   86.28%   86.25%   -0.04%
==========================================
  Files          40       40
  Lines        4099     4102       +3
  Branches     1204     1205       +1
==========================================
+ Hits         3537     3538       +1
- Misses        499      501       +2
  Partials       63       63

Impacted Files
Coverage Δ

packages/cli-plugin-package/src/index.ts
81.93% <50.00%> (-0.23%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


high severity vulnerabilities on fresh install of nextra-theme-blog@alpha

Describe the bug A clear and concise description of what the bug is.
6 high severity vulnerabilities on fresh install into empty directory
To Reproduce Steps to reproduce the behavior:

npm i nextra-theme-blog@alpha
npm audit fix --force

Expected behavior A clear and concise description of what you expected to
happen.
Expected to install nextra alpha with blog theme.
Screenshots If applicable, add screenshots to help explain your problem.
after running npm audit fix --force:
npm warn using --force Recommended protections disabled.

up to date, audited 447 packages in 1s

174 packages are looking for funding
  run `npm fund` for details

# npm audit report

cross-spawn  <6.0.6
Severity: high
Regular Expression Denial of Service (ReDoS) in cross-spawn - https://github.com/advisories/GHSA-3xgq-45jj-v275
fix available via `npm audit fix`
node_modules/cross-spawn
  execa  0.5.0 - 0.9.0
  Depends on vulnerable versions of cross-spawn
  node_modules/execa
    clipboardy  <=1.2.3
    Depends on vulnerable versions of execa
    node_modules/clipboardy
      title  3.0.0 - 3.5.3
      Depends on vulnerable versions of clipboardy
      node_modules/title
        nextra  2.0.0-alpha.0 - 3.2.3 || 4.0.0-app-router.0 - 4.0.0-app-router.27
        Depends on vulnerable versions of title
        node_modules/nextra
          nextra-theme-blog  2.2.12 - 3.2.3 || 4.0.0-app-router.0 - 4.0.0-app-router.27
          Depends on vulnerable versions of nextra
          node_modules/nextra-theme-blog

6 high severity vulnerabilities

To address all issues, run:
  npm audit fix

Desktop (please complete the following information):

OS: MacOS 15.1.1 (24B91)
NPM version 10.9.1

Additional context Add any other context about the problem here.

please precise nextra version installed

nextra-theme-blog@alpha is resolved to "nextra-theme-blog": "^3.0.0-alpha.42" which was released
this issue is fixed in https://github.com/shuding/nextra/issues/3674


phpmd.org is down

I can't reach anything on the phpmd.org domain.  This is making it difficult to learn/use the utility and all links in the HTML reports being generated are broken

Fixed

It is down again :(


Start running SQL Server Integration Tests as part of CI pipeline

Resolves
Fixes #134
Description
We are using GitHub Service Containers to spin up an SQL Server container to run our integration tests against.

This PR is ready for a review

Reviewed as part of stream.


Update Assigned Message

When a bounty hunter is assigned the new message should include the total bounty compensation amount. This should recalculate the bounty based on 1. their multiplier and 2. the base-rate.
New comment template:

Deadline
Thu, 15 Jun 2023 10:47 UTC

Registered Wallet
0x4007CE2083c7F3E18097aeB3A39bb8eC149a341d

Payment Multiplier
1.00

Multiplier Reason
Reason

Total Bounty
100 USD

Tips:

Use /wallet 0x4FDE...BA18 if you want to update your registered payment wallet address @user.
Be sure to open a draft pull request as soon as possible to communicate updates on your progress.
Be sure to provide timely updates to us when requested, or you will be automatically unassigned from the bounty.

I feel like we have two layers of complexity regarding this problem of unexpected payout amounts.

we don't have the labels automatically updating when the base-rate is updated
multipliers

Because money is generally a sensitive topic, we should figure out a solution to clearly express what the payout amount will be. Perhaps in the bot's response for a bounty being assigned, it should clarify what the total bounty compensation will be for the assignee, which will re-check the base-rate AND the current multiplier for the bounty hunter.

Originally posted by @pavlovcik in https://github.com/ubiquity/ubiquibot/issues/379#issuecomment-1593746208

well, I have a question about this issue.
First time I don't register wallet address, so then how can I output it on the table.
For now, in assigned message this kind of message is showed.
It looks like you haven't set your wallet address,
please use /wallet 0x4FDE...BA18 to do so.
(It's required to be paid for the bounty)
so I have to register wallet address by /wallet command.
In updated assign message, I have to show wallet address when I assign.
How can I do that?

/assign

/wallet 0x8c8b5eeea2770e795f2814e802e335bdb9e5a3b0

Sorry if my specification isn't clear but @starlitnightsky you must include the "tips" section below the table as part of the comment. @0xcodercrane


Protect file operations against reusing lfs_file_t belonging to closed files.

Do not allow file operations (except lfs_file_open) on closed files by erroneous reuse lfs_file_t stucture.
It is achived by adding new internal file flag. This flag is set in lfs_file_close and it is tested in each (file related) API call as a precondition.
I also added patch to not allow using of pointers to deallocated memory (some kind of defensive programming).

Hi @Ar2rL, thanks for creating a PR! Sorry it's taken me so long to review this.
I've rebased your branch because of a recent fix to get CI working again: https://github.com/ARMmbed/littlefs/commit/abd90cb84c818a663b584575b019258d01d0065e, let me know if that causes any issues. Also it's curious your commit email points to a different GitHub user.
I'm happy to take in the file protection once we know the code impact. Though some thoughts:

Thoughts on inverting the logic to use a LFS_F_OPENED flag? This may better protect against using files that haven't been opened yet, any files declared in the .bss section for instance.

Thoughts on using asserts instead of LFS_ERR_BADF? This would let users reduce code size further if they want the minimum. (I realize you were copying the RDWR protection logic, thanks for that. I think we should actually change both to assert).

Hi @geky

Adding "inverted logic" was my first follow up after I send this pull request.
I lost a few hours caused by my error of using closed file, so I was focused to protect other "innocent" users ;-) but after some thinking protection against not opened file is also good thing.
Good idea.
Anyway, I use NASA principle "Test what you fly, fly what you test", so my systems have always assertions enabled but I understand that for other users size increase can be very problematic.
BTW> Regarding different GitHub user - it is my first GitHub pull request (I ususually use just git and sometimes Bitbucket), so I messed things a little .

Regarding different GitHub user - it is my first GitHub pull request (I ususually use just git and sometimes Bitbucket), so I messed things a little .

No worries, I was just curious :)
Closing as this is replaced by https://github.com/ARMmbed/littlefs/pull/237


fix: add missing Drawer export

Description
As per title

:tada: This PR is included in version 0.24.4 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Generated ignore file should be smth like this
.redocly.lint-ignore.yaml
openapi.yaml:
  must-provide-mandatory-properties#object-description assertion:
    - '#/components/schemas/Foo/description'
  no-unused-components:
    - '#/components/schemas/Foo'
https://gist.githubusercontent.com/nalesnichok/97351d9860f85170e7df28a89e9f2481/raw/644b2be5caf63ca569ad1aaf849f3e45bb6b273f/petstore.yaml:
  must-provide-mandatory-properties#object-description assertion:
    - '#/components/schemas/Order/description'
bar-ref.yaml:
  must-provide-mandatory-properties#object-description assertion:
    - '#/description'

Run push command.
Check Errors on the API Registry

Expected behavior
Errors should be suppressed and ignored.
Redocly Version(s)
v1.0.0-beta.124
Additional context

Before the push command we made bundle of the definition and after that previously generated .redocly.lint-ignore.yaml is no more valid for bundled definition.

Seems to work correctly now. Not sure when exactly it has been fixed though.


Delete Contract Definition/Offer

Description
As a data space partcipant
I want to write API specifications for deleting a Contract definition/offer as part of Data Governance Feature Set
So that this Contract Offer could later be sent to relevant EDC connectors
In Scope
Writing API Specifications
Out of Scope
Implementation

The latest API specifications can be found in the Data Governance KIT documentation at https://eclipse-tractusx.github.io/docs-kits/category/data-governance-kit


Destroy any owned simulations on delete

@ldodds I think it was only simulations preventing users being deleted (in this instance, anyway)

@ldodds I think it was only simulations preventing users being deleted (in this instance, anyway)

:+1:

:+1:


Which version should I use ?

Hi,
I find everything works fine with branch 0.19.9 but when I try branch master I get a whole load of issues relating to neotoma not being installed
Is this correct ? Am I using the correct version ?
Thx

@jhw Are you using the latest -rc release from hex, or using master? In either case, could you paste the error output here so I can troubleshoot?

Sorry about that. Am away from laptop so will post precise error later but
essentially problem was that 'mix release' complained that erlware commons
required neotoma (sp). Had to manually include neotoma as a dep, then go
through a series of get/compile deps stages. This was on master branch.
On 15 Dec 2015 16:46, "Paul Schoenfelder"<EMAIL_ADDRESS>wrote:

@jhw https://github.com/jhw Are you using the latest -rc release from
hex, or using master? In either case, could you paste the error output here
so I can troubleshoot?
—
Reply to this email directly or view it on GitHub
https://github.com/bitwalker/exrm/issues/262#issuecomment-164823344.

Are you using conform?

justin@justin-ThinkPad-X240:~/work/hello_phoenix$ MIX_ENV=prod mix release
==> connection
Compiled lib/connection.ex
Generated connection app
==> erlware_commons (compile)
ERROR:
You need to install neotoma to compile PEG grammars
Download the latest tarball release from github
https://github.com/seancribbs/neotoma
and install it into your erlang library dir
==> hello_phoenix
** (Mix) Could not compile dependency :erlware_commons, "/usr/bin/rebar" command failed. You can recompile this dependency with "mix deps.compile erlware_commons", update it with "mix deps.update erlware_commons" or clean it with "mix deps.clean erlware_commons"
justin@justin-ThinkPad-X240:~/work/hello_phoenix$
I can proceed from this point by

adding neotoma dep
adding neotoma application
running various versions of 'mix deps.compile', 'mix compile'

But much more trouble than simply using v0.19.9 (what's the stable version ?)
Not using conform (what is conform ?)
Running Ubuntu 14.04
justin@justin-ThinkPad-X240:~/work/hello_phoenix$ elixir --version
Elixir 1.1.1

I'm unable to reproduce this with Elixir 1.1.1 and exrm 1.0.0-rc7. Could you blow away deps, _build, and run mix deps.clean --unused && mix deps.update exrm && mix deps.update erlware_commons? It may have been a temporary issue with erlware_commons that is no longer reproducible.

@bitwalker could you kindly make another rc release to hex.pm which could include #276?
due to limitation of our current internal setup, package from hex.pm is much easier to work with compared to package from git repos

I am having the same issue with 1.0.0-rc7. Works fine with 0.19.9
When I run mix deps.get with 0.19.9 it lists neotoma as a dependency. It doesn't for 1.0.0-rc7.
$ mix deps.get
Running dependency resolution
Dependency resolution completed
  bbmustache: 1.0.3
  conform: 0.17.0
  erlware_commons: 0.15.0
  exrm: 0.19.9
  getopt: 0.8.2
  neotoma: 1.7.3
  providers: 1.4.1
  relx: 3.5.0

here is output for RC7
$ mix deps.get
Running dependency resolution
Dependency resolution completed
  bbmustache: 1.0.3
  erlware_commons: 0.15.0
  exrm: 1.0.0-rc7
  getopt: 0.8.2
  providers: 1.4.1
  relx: 3.5.0

The strange thing is, the RC7 works on my Mac. This problem appears only on my CI machine, and only on one git branch. I could not find any reasons why they behave differently..

@mrhooray @arkadiyk Just FYI, 1.0.0-rc8 has been released.

thanks @bitwalker


Use a binding for compose view-model

Hello,
I'm getting this:
Potentially unhandled rejection [1] TypeError: Cannot read property 'moduleId' of undefined
    at HtmlBehaviorResource.load (http://localhost:9000/jspm_packages/github/aurelia/templating@0.10.3/html-behavior.js:134:59)

Here is Git: https://github.com/tomasbonco/aurelia-issue
Tested in aurelia 0.12.0 and 0.12.2.
Source code for quick code review:
app.jade
template

	compose( view-model.bind="components.dialog" view="./components/dialog/dialog" )

app.js
import {inject} from 'aurelia-framework'
import {Dialog} from 'components/dialog/dialog'

@inject( Dialog )
export class App
{
	constructor( dialog )
	{
		this.components = {}
		this.components.dialog = dialog
	}
}

Thanks for help!

If you set a breakpoint in the transpiled code is Dialog defined on the line that looks like this:
  return {
    setters: [function (_aureliaFramework) {
      inject = _aureliaFramework.inject;
    }, function(_dialog) {
      Dialog = _dialog.Dialog;  // <--- here (it may not look exactly like this)
    }],

I'm sorry, is that a question? Where exactly should I see it (and why)?
dialog.js is compiled into:
System.register([], function (_export) {
	var _classCallCheck, Dialog;

	return {
		setters: [],
		execute: function () {
			'use strict';

			_classCallCheck = function (instance, Constructor) { if (!(instance instanceof Constructor)) { throw new TypeError('Cannot call a class as a function'); } };

			Dialog = function Dialog() {
				_classCallCheck(this, Dialog);

				console.log('If I get penny for every time Im called ...');
			};

			_export('Dialog', Dialog);
		}
	};
});

And property target in viewStrategy.moduleId = Origin.get(target).moduleId; is:
function Dialog() {
	_classCallCheck(this, Dialog);

	console.log('If I get penny for every time Im called ...');
}

apologies- I wasn't very clear- what I meant was if you use the chrome debugging tools and set a breakpoint in app.js, is Dialog undefined?  I'm referring to Dialog, the constructor function/class- not dialog the variable/argument in your App constructor.

No it's not:

When examining originStorage, there is no Dialog. Do I have to do it manually?

I updated repo, with html (so jade is no longer needed)

Looks like two issues here:

The module has not been <require>d. This results in what I assume to be the module cache trying to grab the module and assuming it's already been loaded.

If the require is added I get another error: (getObserversLookup on undefined)

I've debugged this, I get down to the dynamic-element branch in composition-engine.js. This:
    metadata = new HtmlBehaviorResource();
    metadata.elementName = 'dynamic-element';
    doneLoading = metadata.load(childContainer, viewModel.constructor, instruction.view, true);

Sets up the metadata and then this:
 return doneLoading.then(function (viewFactory) {
                return metadata.create(childContainer, {

Tries to create behaviour.
The only place I can see the observerLocator property being added to the metadata is during analyze where it's grabbed from the DI container:
analyze(container, target){
    var proto = target.prototype,
        properties = this.properties,
        attributeName = this.attributeName,
        i, ii, current;

    // Here:
    this.observerLocator = container.get(ObserverLocator);

So without being pushed through the analyze pipeline the locator is never set
Without being a JS guru or knowing much about the framework (yet!) it looks like analyze sets up the metadata by looking at the view/viewmodel and inspecting what options are set, in which case the below causes that to happen on dynamic elements
    metadata = new HtmlBehaviorResource();
    metadata.elementName = 'dynamic-element';

    if(viewModel)
        metadata.analyze(childContainer, viewModel.constructor);

    doneLoading = metadata.load(childContainer, viewModel.constructor, instruction.view, true);

Which results in it all working properly


How do we set a secret's value via the CDK; we anticipate that people will want to set secrets during deployment to capture parameter values.

Related from Aspire: https://github.com/dotnet/aspire/issues/2587

Opened in error. Intellisense wasn't showing me Properties.Value for some reason (fixed after a VS restart).


bucketfile record log service for backbeat

Enable or disable record log service provided in https://github.com/scality/Arsenal/pull/253

@ironman-machine try

Hello @jonathan-gramain
Starting end to end procedure using the following payload:
{"REPO_NAME": "S3", "DEFAULT_BRANCH": "master", "SCALITY_S3_BRANCH": "ft/S3C-301-recordLog"}
Please follow http://ci.ironmann.io/gh/scality/Integration/14140 for CI status.


corrupted on transfer: sizes differ

On OneDrive, I get a lot of errors like this one:
2017/10/06 05:50:23 ERROR : Photos/2009/San Francisco/San francisco Loulou/Photo0376.jpg: corrupted on transfer: sizes differ 105608 vs 87114

with the command:
rclone -v sync OneDrive:/ /mnt/ssd/data/OneDrive
If I run the same sync command again, I get exactly the same errors, always on the same files.
There are two distinct cases with exactly the same error:

Either, when I look at the file on onedrive, it looks ok. If I download the file from the onedrive website, the file is ok.
Or the file does not exist on OneDrive (I can't see it on the web site)

I'm using rclone v1.38 on raspbian stretch and on Linux Mint 18 with the same errors on same files.
I tried the latest beta (17/10/02), same...

rclone -v sync OneDrive:/ /mnt/ssd/data/OneDrive

I suspect this is the same as #454 and #399 for which I implemented the --ignore-size option.
For some reason, with some photos, onedrive tells rclone they are one size, but actually they are another size.
Try that and see if it works?

Thanks @ncw , it works with the --ignore-size option.


Can't dynamically create tests

If I try to create tests in BDD style with it() dynamically at "runtime", Mocha ignores them. See below for an example (live viewable example at http://sil.jsbin.com/vuteko/edit?html,output).
Note that if I populate TEST_NAMES statically (hardcode the entries into it in the global scope) then it works fine, but attempting to add them in before() does not work, even though before runs before the tests themselves (that's why it's called "before", after all). It does not seem to run before the thing which gathers which tests there are, though. Is there any way around this?
<!DOCTYPE html>

    <meta charset="utf-8">
    <title>Mocha: dynamic tests don't work (hotlinking from mocha site)</title>
    <link rel="stylesheet" href="http://mochajs.org/example/mocha.css">

Observe that there is no section called "Dynamically created tests" above, although there should be.

You can generate tests in this way, but before() only runs after all tests have been defined.
If you populate TEST_NAMES in the describe() directly instead of the before() your example will work as you expect.

You actually can (ab)use before() to dynamically generate It() tests from asynchronous data. First you create a placeholder It() test that forces before() to execute, and then you generate more It() tests inside of the async callback/promise/whatever in the before() body.
Here's some sample code reproduced from my stackoverflow answer on this topic:
before(function () {
    console.log('Let the abuse begin...');
    return promiseFn().
        then(function (testSuite) {
            describe('here are some dynamic It() tests', function () {
                testSuite.specs.forEach(function (spec) {
                    it(spec.description, function () {
                        var actualResult = runMyTest(spec);
                        assert.equal(actualResult, spec.expectedResult);
                    });
                });
            });
        });
});

it('This is a required placeholder to allow before() to work', function () {
    console.log('Mocha should not require this hack IMHO');
});

The answer provided by @rob3c works, though a more proper way would be to use the --delay option, which is documented here. This gives you direct control of the flow of defining setup tasks and test cases before Mocha starts running them.
Rewriting the above example with this method:
describe('here are some dynamic It() tests', function () {
	testSuite.specs.forEach(function (spec) {
		it(spec.description, function () {
			var actualResult = runMyTest(spec);
			assert.equal(actualResult, spec.expectedResult);
		});
	});
	setImmediate(run); // run() should be called after all describe functions are executed
	//run();  doing this here instead would be too soon, and mocha likes to hang.
});

--delay is a global option so run() should only be called once, after all tests are described. The above example is fine if it's the only asynchronously defined test, but if you have multiple tests across multiple files, it would be necessary to track their loading state before finally calling run().
Thanks to @boneskull for pointing out this option!

The point of using my method instead of the global run hook, is that you aren't required to globally coordinate your dynamic test generation. With my method, you can make those decisions per-file on an ad-hoc basis without requiring any global efforts to call the single run method. There's no "proper" way to do that except in the way I showed...until mocha provides proper support for it, of course.

Also, the placeholder test can be skipped since it doesn't do anything anyway:
it.skip("Placeholder needed to trigger mocha before() block", function () {});

@npopov-d3 Thanks for the skip tweak for the placeholder!
Unfortunately, I don't know of a better async testing framework offhand, as this simple hack is working for us, and we have already have a large investment in mocha. However, if you find something that has nicer async dynamic test allocation support that is backwards compatible with mocha, please let us know.

my stackoverflow answer

@rob3c - I tried your solution(see this post ) , but could not get this working as expected as I see the actual test does not get executed in the before, only the initialization happens .


[breaking] Add prediction fucntion for DMatrix and use inplace predict for dask.

This PR is about to wrap up https://github.com/dmlc/xgboost/pull/6638, only that sklearn is still using DMatrix for prediction by default instead of inplace_predict.

Add a new API function for predicting on DMatrix.  This function aligns with rest of the InplacePredictFrom* functions on semantic of function arguments.
Purge ntree_limit from libxgboost, use iteration instead.
[dask] Use inplace_predict by default for dask sklearn models.
[dask] Run prediction shape inference on worker instead of client.

The breaking change is in the Python sklearn apply function, I made it to be consistent with other prediction functions where best_iteration is used by default. Also, close https://github.com/dmlc/xgboost/issues/6553

@RAMitchell @ShvetsKS @SmirnovEgorRu This is a big change, could you please help taking a look?

To make inplace predict the default for sklearn, we need to have some more adapters like coo, csc.

Something wrong with the docker build.  Please ignore it for review as the last test run was successful.

My understanding of this PR is that the predict c_api is being changed to use a json input, and ntreelimit is being removed in favour of number of iterations.

That's right.  A lot of changes are devoted to removing the ntree_limit in the codebase.  So the PR looks ugly huge.

What happens in the JVM package? I guess it will stay on the old interface until someone updates it.

It doesn't use ntree_limit so should be easy to update it.  What's I'm worrying about is the R package, I will make corresponding change, but may need some help from @hcho3 .

I'm quite excited to remove ntree_limit, it's troubling me for a while.

@ShvetsKS can you take a look at this also? Thanks

@ShvetsKS @SmirnovEgorRu would you like to help creating these adapters?

@trivialfis Sure! Sorry for late response. Could you clarify the required time frame for finishing this work?

@trivialfis Sure! Sorry for late response. Could you clarify the required time frame for finishing this work?

No problem, I don't have an exact timeline for this, just part of improving the prediction function and memory usage long term roadmap.  I will be working on categorical data and dask for a while so take your time.
At the meanwhile, could you please help taking a look into this PR?  It should set up everything needed for future development.

No need to pull them out, but in the future it would probably be better to do a big formatting cleanup as a separate PR.

Thanks for the suggestion!  I tried to go through my PR again, I think some places look like formatting change, but they have actual change like parameter addition.  Feel free to point out where the change is not necessary.  @RAMitchell mentioned formatting issue in my previous PRs a few time. ;-)

Codecov Report

Merging #6668 (95632bc) into master (1e94911) will decrease coverage by 0.07%.
The diff coverage is 85.07%.

@@            Coverage Diff             @@
##           master    #6668      +/-   ##
==========================================
- Coverage   81.47%   81.39%   -0.08%
==========================================
  Files          13       13
  Lines        3719     3757      +38
==========================================
+ Hits         3030     3058      +28
- Misses        689      699      +10

Impacted Files
Coverage Δ

python-package/xgboost/dask.py
81.65% <81.25%> (-1.03%)
:arrow_down:

python-package/xgboost/sklearn.py
90.57% <84.61%> (-0.14%)
:arrow_down:

python-package/xgboost/core.py
81.92% <90.47%> (+0.07%)
:arrow_up:

python-package/xgboost/training.py
95.60% <100.00%> (+0.28%)
:arrow_up:

python-package/xgboost/data.py
62.63% <0.00%> (+0.07%)
:arrow_up:

python-package/xgboost/tracker.py
95.11% <0.00%> (+1.12%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1e94911...95632bc. Read the comment docs.

Close https://github.com/dmlc/xgboost/issues/6621 .

@trivialfis is it expected that with current changes PredictBatchByBlockOfRowsKernel function is called even if subsampling is not used (equal to '1')?
It was discovered that during each training iterations PredictBatchByBlockOfRowsKernel is called now

@ShvetsKS I'm not sure how much overhead it has, but I can make a special condition to avoid calling predict if the number of trees for prediction is 0.  Thanks for catching that!   Is there any other concern?

@ShvetsKS Added a guard.

@ShvetsKS I'm not sure how much overhead it has, but I can make a special condition to avoid calling predict if the number of trees for prediction is 0. Thanks for catching that! Is there any other concern?

LGTM. No other concerns.

@RAMitchell @wphicks @ShvetsKS Thanks for the review!

Thanks for the suggestion! I tried to go through my PR again, I think some places look like formatting change, but they have actual change like parameter addition. Feel free to point out where the change is not necessary. @RAMitchell mentioned formatting issue in my previous PRs a few time. ;-)

Yep, like I said, not a big deal for this PR, and I'm glad it made it in already :tada:! Just for future reference, I was talking about things like this. Those single-quotes didn't need to be converted to double-quotes. As a matter of fact, at a quick glance, I'm not sure that that file needed to be touched at all.  Anyway, definitely nothing to sweat about :smile:! Just thought I'd mention it since leaving those out will help folks power through review much quicker in the future.

@wphicks

hose single-quotes didn't need to be converted to double-quotes.

Ah ... you are right, that was black.  Will be more careful next time.


Use vscode directly instead of monaco

So I found this recently which shows that vscode can run directly from the browser hence it should potentially run in NW.js.
Advantages over monaco would be:

direct integration of vscode extensions in the code editor of Hide
Minimize duplication of work on the extension code and the potential monaco extension
The code from the project in the aforementioned webapp is available here and could serve as an example.

Disavantages would be:

learning how to integrate vscode for the web
then implementing that in context of nodewebkit.

What's the rationale for using VSCode ? We only need to integrate the text editor part in Hide, we don't need all the extensions, and since hide has it's own main menu and panels, I fail to see how that would work.

If we don't need the extensions does that mean that there will be no intellisense for haxe or hashlink debugging ?  If you want to have those in Hide then it would be easier to just use vscode and use the vshaxe extensions. Plus we could have an integrated terminal if we use vscode. If it is not in the scope of hide to have intellisense, debugging and a terminal then you are right we only need monaco.
But I think it would be a plus to have debugging and intellisense directly in Hide so that we minimize the number of apps installed to develop with Heaps. This would work in the same sense as how Godot engine works, having everything there for the users. We can just switch editor views and we get the different utilities for every type of layout.

Maybe it would be possible to remove the panels/menus that are not needed from vscode in hide.

What you want is quite outside of the goal of HIDE, we don't want to edit Haxe code, compile and debug within HIDE, we prefer to keeps things separated.
HIDE is used in our teams by both Developers and Graphics team, so we prefer to have something neutral and not developer focused. Using two separate screens it is perfect to have VSCode on one screen and HIDE on the other.
We have actual intellisense support within Monaco, but we use it to display custom completion for HScript scripts (hence the support for opening .hx files in HIDE).

Yeah that's what I thought :P I wanted to inform of the possibility, but it is something that I thought would be possibly out of scope for HIDE, which I fully understand considering that it is a tool used in development. I just thought initially, since monaco was added as an editor, something like the script editor in the godot editor was envisioned. Thanks for the fast response !


Failure of building nokogiri is due to failure of building libxml2 2.9.4

Could you help me, please?
I found an issue when building libxml2 2.9.4 during installation of nokogiri. (gem install nokogiri)
The macro HAVE_LZMA_H is NOT set to 1, so that libxml2 cannot find LZMA_OK in lzma/base.h. In fact, it doesn't include this header files. Maybe something is wrong in extconf.rb. How can I fix it manually?
Thanks
ENV:
OS: macOS sierra + Homebrew
Dependency Libs: xz (lzma.h included) had been installed
Ruby: 2.3.1 (with rbenv 1.0.0)

For now I installed nokogiri with homebrew libxml2.
PKG_CONFIG_PATH="$(brew --prefix)/opt/libxml2/lib/pkgconfig" \
LDFLAGS="-L$(brew --prefix)/opt/libxml2/lib" \
CPPFLAGS="-I(brew --prefix)/opt/libxml2/include" \
  gem install nokogiri -- --use-system-libraries

(all config are from brew info libxml2)
excerpt from the gem_make.out when just running gem install nokogiri
************************************************************************
Extracting libxml2-2.9.4.tar.gz into tmp/x86_64-apple-darwin16.0.0/ports/libxml2/2.9.4... OK
Running 'configure' for libxml2 2.9.4... OK
Running 'compile' for libxml2 2.9.4... ERROR, review '<homedir>/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/nokogiri-1.6.8/ext/nokogiri/tmp/x86_64-apple-darwin16.0.0/ports/libxml2/2.9.4/compile.log' to see what happened. Last lines are:
========================================================================
    unsigned short* in = (unsigned short*) inb;
                         ^~~~~~~~~~~~~~~~~~~~~
encoding.c:815:27: warning: cast from 'unsigned char *' to 'unsigned short *' increases required alignment from 1 to 2 [-Wcast-align]
    unsigned short* out = (unsigned short*) outb;
                          ^~~~~~~~~~~~~~~~~~~~~~
4 warnings generated.
  CC       error.lo
  CC       parserInternals.lo
  CC       parser.lo
  CC       tree.lo
  CC       hash.lo
  CC       list.lo
  CC       xmlIO.lo
xmlIO.c:1450:52: error: use of undeclared identifier 'LZMA_OK'
    ret =  (__libxml2_xzclose((xzFile) context) == LZMA_OK ) ? 0 : -1;
                                                   ^
1 error generated.
make[2]: *** [xmlIO.lo] Error 1
make[1]: *** [all-recursive] Error 1
make: *** [all] Error 2

Try xcode-select --install and then retry the gem install nokogiri command.

@scharfie that works! It's strange since I had no problem with building ruby or other gems with native extensions..

Thanks @scharfie, it works. I think it's because I was using the building tools within Xcode itself which could not find the path of XZ outside of Xcode sandbox, but the command tools of Xcode could find it.

Thanks @scharfie, worked like a charm!

Future readers, please go to the nokogiri.org installation tutorial for help installing Nokogiri.


Temporarily disable integration tests that need the apt plugin

Signed-off-by: Michael Abel<EMAIL_ADDRESS>Proposed changes
These tests rely on a working tedge apt plugin.
However, in the current integration-test-workflow.yml the plugin is not installed (currently on purpose).
Until the release, I propose to run the tests manually and disable them temporarily to avoid issues in CI.
Afterwards, we should prepare the right environment for the tests afterwards.
Soon after the release should do one of these:
a) Install the plugin in the workflow
b) Move the tests to a test-job where we have tedge installed (yet to be created) (e.g. a integration- or system-test crate)
Types of changes

[ ] Bugfix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Improvement (general improvements like code refactoring that doesn't explicitly fix a bug or add any new functionality)
[ ] Documentation Update (if none of the other choices apply)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] Test-Smell : Ignored test (anti-feature); to be repaired soon.

Paste Link to the issue
https://github.com/thin-edge/thin-edge.io/issues/1000
Checklist

[x] I have read the CONTRIBUTING doc
[x] I have signed the CLA (in all commits with git commit -s)
[ ] I ran cargo fmt as mentioned in CODING_GUIDELINES
[ ] I used cargo clippy as mentioned in CODING_GUIDELINES
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] I have added necessary documentation (if appropriate)

for anyone wondering, these tests are covered in python anyway.


Support Module for TestNG

As with the webtester-support-junit module, it would be nice to have a webtester-support-testng module which offers the same kinds of features as the JUnit modules.

Browser management
Entry points
Configuration value injection
Page initialization

PR: #78

done


Version conflicts with new Watson Studio Spark Python 3.6

To avoid current version conflicts for Spark Python 3.6 version default runtime environment
tensorflow 1.13.1 requires tensorboard<1.14.0,>=1.13.0, which is not installed.
ibm-cos-sdk-core 2.4.3 has requirement urllib3<1.25,>=1.20, but you'll have urllib3 1.25.7 which is incompatible.
botocore 1.12.82 has requirement urllib3<1.25,>=1.20, but you'll have urllib3 1.25.7 which is incompatible.

Add
!pip uninstall -y botocore
!pip install 'botocore==1.12.253'
!pip uninstall -y urllib3
!pip install 'urllib3==1.24.3'
!pip uninstall -y tensorboard
!pip install 'tensorboard==1.13.1'

to the notebook

refreshed pattern will not use spark.


Node v12 Crashes

ever since #39 the bot has been crashing constantly after:
ENOENT and then uncaughtException
Changes; Discord v12 & Node.js 8 -> Node.js 12

Possible POC:
Cause:
at handlers/helper.js#L40 @ in the function readFile, when any error occurs, log("error reading file " + err) is returned to variables expecing JSON output. When parsed (eg. guildSettings.prefix) it returns uncaughtException errorTypeError: Cannot convert undefined or null to object.
once this error is passed, the bot becomes unresponsive to all commands and shortly appears offline, but disconnected timers will still function and the nodejs program will still be in a running state.
This originates from upgrading Node.js to v12 since uncaughtExceptions will exit the program with a non-1 exit code
https://medium.com/dailyjs/how-to-prevent-your-node-js-process-from-crashing-5d40247b8ab2

POC:
niles-poc.zip


admin not working with utf-8 import of csv file

When trying to import a file containing names with foreign characters in utf-8 format using the admin mixin, import-export either fails or mangles the characters.
This seems to be because when storing the uploaded data in a file in the temp directory prior to processing the data it uses text mode, which then complains on certain unicode combinations. If I change get_read_mode in formats to 'rb', everything then works properly.
Is this a bug, or am I not setting something up correctly.
I'm using django 3.1 and python 3.8
Thanks,

Are you on Windows? Could you try to apply that patch to see if it makes a difference?
diff --git a/import_export/admin.py b/import_export/admin.py
index acd51fe..3ae90a1 100644
--- a/import_export/admin.py
+++ b/import_export/admin.py
@@ -255,7 +255,7 @@ class ImportMixin(ImportExportMixinBase):
         for chunk in import_file.chunks():
             data += chunk

-        tmp_storage.save(data, input_format.get_read_mode())
+        tmp_storage.save(data, mode='wb')
         return tmp_storage

     def import_action(self, request, *args, **kwargs):

hi, claudep, I have the same issue than bilkugs. I tried the patch above and it doesn't solve the import encoding problem for utf8 csv (with bom or not) on windows 10 cpython 3.8.1. everything is fine in ANSI.

I have no windows system to test with, so I'm afraid someone else should try to debug what's happening, where exactly the problem lies.

Im going to close this in deference to #1141


Fix stack filtering

Bug introduced by #48413
Before this change, falsely returned matches for stack frame lists that were too short, resulting in out of range errors when trying to set reasons.

Looks like #49917 affected the test runs. Re-running to see if it resolves again.

Reruns failed with gsutil error, rerunning again.

It seems like it's consistently failing on this PR for some reason (this PR does not affect goldens).

Can you push a new commit on this?
I have a suspicion that Gold is receiving the results, just returning bad state. https://flutter-gold.skia.org/changelists for this PR shows image results, but we've re-run them a few times with different flakes, so I don't know if they all came from the same test run. I am wondering if all the images are actually accounted for.

Pushed an empty commit (3241507).  Now watch it not flake :)

Flaked worse this time, 26 and 7 tryjob flakes across the two linux shards. I have checked the gold dashboard against the flakes and the images do not appear to be there. :(
Thanks for letting me check that.

Patching in #50088 has made the gold related failures go away.

Hm.  Different failure on mac now:
https://cirrus-ci.com/task/6635508625309696
mp/flutter sdk/packages/flutter/test/cupertino/text_field_test.dart: Cupertino cursor golden (TargetPlatform.macOS)
══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞════════════════════════════════════════════════════
The following _Exception was thrown while running async test code:
Exception: Unexpected Gold tryjobAdd failure.
Tryjob execution for golden file test cupertino.text_field_cursor_test.cupertino_macos.1.png failed
for
a reason unrelated to pixel comparison.
Debug information for Gold:
stdout:
stderr: ERROR: logging before flag.Parse: I0204 01:11:34.738559   64806 auth.go:364] auth.go:364
Read from file /private/tmp/flutter
sdk/bin/cache/pkg/skia_goldens4761/packages/flutter/test/cupertino/serviceAccount.json
Error running command: ''gold client not ready: Gold results fields invalid: Received nil pointer
for GoldResult. At jsonio.go:197 goldclient.go:468 goldclient.go:301 goldclient.go:291
cmd_imgtest.go:338 command.go:835 command.go:919 main.go:42 proc.go:203 asm_amd64.s:1357''
When the exception was thrown, this was the stack:
#0      SkiaGoldClient.tryjobAdd (package:flutter_goldens_client/skia_client.dart:371:9)
<asynchronous suspension>
#1      _AuthorizedFlutterPreSubmitComparator.compare (package:flutter_goldens/flutter_goldens.dart:374:23)
<asynchronous suspension>
#2      MatchesGoldenFile.matchAsync.<anonymous closure> (package:flutter_test/src/_matchers_io.dart:82:57)
<asynchronous suspension>
#3      AutomatedTestWidgetsFlutterBinding.runAsync.<anonymous closure> (package:flutter_test/src/binding.dart:924:22)
#6      AutomatedTestWidgetsFlutterBinding.runAsync (package:flutter_test/src/binding.dart:922:26)
#7      MatchesGoldenFile.matchAsync (package:flutter_test/src/_matchers_io.dart:72:20)
#9      MatchesGoldenFile.matchAsync (package:flutter_test/src/_matchers_io.dart:52:28)
#10     _expect (package:test_api/src/frontend/expect.dart:116:26)
#11     expectLater (package:test_api/src/frontend/expect.dart:75:5)
#12     expectLater (package:flutter_test/src/widget_tester.dart:385:10)
#13     main.<anonymous closure> (file:///private/tmp/flutter%20sdk/packages/flutter/test/cupertino/text_field_test.dart:523:11)
#26     AutomatedTestWidgetsFlutterBinding.runTest.<anonymous closure> (package:flutter_test/src/binding.dart:1102:17)
#28     AutomatedTestWidgetsFlutterBinding.runTest.<anonymous closure> (package:flutter_test/src/binding.dart:1090:35)
(elided 31 frames from class _FakeAsync, dart:async, dart:async-patch, and package:stack_trace)
════════════════════════════════════════════════════════════════════════════════════════════════════

Hm. Different failure on mac now:
https://cirrus-ci.com/task/6635508625309696

Looks like this passed on a re-run? Is there a bug for tracking this yet? I can open one to track it down.

Passed on a rerun - I haven't opened a bug yet, if you don't mind that'd be awesome


Category filter on Apps page has visual rendering issues

Go to the Apps & Marketplace view.
In the top-right, the 'All Categories' drop down has no border and the refresh icon overlaps with the drop-down arrow:

Summary
The issue appears to have been resolved. I could not reproduce the issue with a v2.5.5 install, but the overlap does not occur.

Steps taken to reproduce the issue: installed with the following configuration...

Installation option (single install/HA): single
Browser: Chrome 88.0.4324.182
OS: macOS Big Sur 11.2.1
Arch: amd64

Rancher version on which the issue was reproduced: n/a
2.5-head commit id: 96dc206
Steps taken to see the issue fixed: installed v2.5-head and resized the window repeatably to try to recreate the issue.
Check PR to see if anything else is fixed: done.
Validate everything in the PR: done.

Result
Rancher version: v2.5-head


Spelling Error in Readme fix

Fix for Issue #18

Thank YOU, this is my first official contribution :).

Awesome 🤓 - keep going 💪


Page segmentation output ocr_float

I'm trying to reproduce results achieved at the ICDAR page segmentation competitions [1,2] with tesseract. I'm struggling to get the tool to output the hOCR tags that I'm expecting for tables and figures etc [3]. At the moment I'm calling tesseract with pagesegmode 1. Should I be adding other options via a config file to achieve the full extent of tesseracts segmentation and labelling ability (I'm not interested in the character recognition element as much).

Antonacopoulos (2013, ICDAR) ICDAR2013 Competition on Historical Book Recognition – HBR2013
Antonacopoulos (2013, ICDAR) ICDAR2013 Competition on Historical Newspaper Layout Analysis – HNLA2013
Breuel (2010) The hOCR Embedded OCR Workflow and Output Format

You can use the C-API to only retrieve the page segmentation without doing character recognition. Use TessBaseAPISetPageSegMode to set the segmentation mode, call TessBaseAPIProcessPages, and finally retrieve the page iterator using TessBaseAPIAnalyseLayout. Iterate using the TessPageIteratorNext function at the lowest level and check with TessPageIteratorIsAtBeginningOf if the current symbol is at the start of a new block. All in all it shouldn't be more than a few lines of C code and you're skipping the recognition part of tesseract completely.

For support please use tesseract-ocr user forum. See FAQ[1]
[1] https://github.com/tesseract-ocr/tesseract/wiki/FAQ#rules-and-advises

@zdenop thank's for clarifying. Here is the link to my forum post (which contains another answer): https://groups.google.com/forum/#!topic/tesseract-ocr/1Frh-5ggNxg

This issue is currently the top search result for 'ocr_float'; it lacks a simple summary: Tesseract (currently) does not support ocr_float.

@jimregan Cheers! I'm reproducing your answer on the linked forum page (the preferred help location).

That seems a bit redundant; I was merely summarising what you were told there :)


tests/fields: False positive for fields with null values, reported as "missing" incorrectly.

There appears to be a bug in the ./tests/fields test/utility, causing some fields to be falsely reported as "missing".
For example, in the following test case:
{"repos/google/go-github/issues/1", &github.Issue{}},

The real GitHub API response from https://api.github.com/repos/google/go-github/issues/1 includes:
...
    "site_admin": false
    }
  ],
  "milestone": null,
  "comments": 2,
  "created_at": "2013-05-30T18:35:59Z",
  "updated_at": "2013-08-20T22:47:14Z",
...

Note that the value of milestone is null.
The corresponding struct field Issue.Milestone exists:
https://github.com/google/go-github/blob/d9c241b9c95cbd5996418f70223328a37cfb9bb3/github/issues.go#L42
But the output from the fields test incorrectly reports:
...
*github.Issue missing field for key: milestone (example value: <nil>)
...

I think it's because the null value gets dropped when JSON marshalling the Issue struct, because of ,omitempty option.

There are multiple approaches to solving the issue. I can't think of one without problems.
Essentially, we want to either modify the struct being marshaled into JSON to strip its "omitempty" JSON options. Alternatively, we can use reflection and (re)implement encoding/json rules for mapping struct fields to JSON keys.
I've prototyped the latter, and it works (milestone key is no longer incorrectly reported as missing), but it's not cleaned up and not finished. Here is a WIP patch for reference. See TODOs for limitations.
commit 6883f03201546121013b6d67674a7451f87fe639
Author: Dmitri Shuralyov<EMAIL_ADDRESS>Date:   Sat Mar 4 22:26:16 2017 -0500

    WIP: tests/fields: Fix #576.

    TODO: Decide on the high-level approach, clean up, finish.

diff --git a/tests/fields/fields.go b/tests/fields/fields.go
index bd1463e..bc6d417 100644
--- a/tests/fields/fields.go
+++ b/tests/fields/fields.go
@@ -59,12 +59,13 @@ func main() {
 		typ interface{}
 	}{
 		//{"rate_limit", &github.RateLimits{}},
-		{"users/octocat", &github.User{}},
-		{"user", &github.User{}},
-		{"users/willnorris/keys", &[]github.Key{}},
-		{"orgs/google-test", &github.Organization{}},
-		{"repos/google/go-github", &github.Repository{}},
-		{"/gists/9257657", &github.Gist{}},
+		//{"users/octocat", &github.User{}},
+		//{"user", &github.User{}},
+		//{"users/willnorris/keys", &[]github.Key{}},
+		//{"orgs/google-test", &github.Organization{}},
+		//{"repos/google/go-github", &github.Repository{}},
+		{"repos/google/go-github/issues/1", &github.Issue{}},
+		//{"/gists/9257657", &github.Gist{}},
 	} {
 		err := testType(tt.url, tt.typ)
 		if err != nil {
@@ -106,31 +107,25 @@ func testType(urlStr string, typ interface{}) error {
 		}
 	}

-	// unmarshal to typ first, then re-marshal and unmarshal to a map
-	err = json.Unmarshal(*raw, typ)
-	if err != nil {
-		return err
-	}
-
-	var byt []byte
-	if slice {
-		// use first item in slice
+	// Populate m2 with all fields from typ,
+	// using encoding/json rules for mapping struct fields to JSON key names.
+	var m2 = make(map[string]struct{})
+	{
 		v := reflect.Indirect(reflect.ValueOf(typ))
-		byt, err = json.Marshal(v.Index(0).Interface())
-		if err != nil {
-			return err
+		if slice {
+			v = v.Index(0)
 		}
-	} else {
-		byt, err = json.Marshal(typ)
-		if err != nil {
-			return err
+		t := v.Type()
+		if t.Kind() != reflect.Struct {
+			return fmt.Errorf("typ is %v (%T), expected a struct", typ, typ)
+		}
+		for i := 0; i < t.NumField(); i++ {
+			name, ok := structFieldToJSONKeyName(t.Field(i))
+			if !ok {
+				continue
+			}
+			m2[name] = struct{}{}
 		}
-	}
-
-	var m2 map[string]interface{}
-	err = json.Unmarshal(byt, &m2)
-	if err != nil {
-		return err
 	}

 	// now compare the two maps
@@ -145,3 +140,29 @@ func testType(urlStr string, typ interface{}) error {

 	return nil
 }
+
+// structFieldToJSONKeyName returns JSON key name that the struct field maps to, if any,
+// according to encoding/json rules.
+// TODO: This doesn't fully include embedded structs...
+// TODO: This also doesn't fully implement all encoding/json rules. For example,
+//       there's no valid tag check (isValidTag), etc. If encoding/json rules change,
+//       this code will be out of date, since it duplicates its private functionality.
+//       However, this might be sufficient (good enough) for the limited purposes of this tool.
+func structFieldToJSONKeyName(field reflect.StructField) (string, bool) {
+	if field.PkgPath != "" && !field.Anonymous { // unexported
+		// json.Unmarshal will only set exported fields of the struct.
+		return "", false
+	}
+	tag, ok := field.Tag.Lookup("json")
+	if !ok {
+		return field.Name, true
+	}
+	if tag == "-" {
+		return "", false
+	}
+	name := strings.Split(tag, ",")[0]
+	if name == "" {
+		return "", false
+	}
+	return name, true
+}

I'm new to go, have been using this project and I'd like to contribute. Can I help with finishing off this issue?
Thanks,

You're certainly welcome to, thanks!
This is a hard issue. If you think you have ideas for how to tackle it, I suggest you discuss them here before sending code for review. That way, we can make smaller steps and see whether they're headed in the right direction to resolve the issue.

Thanks for getting back to me.
I'm very new to Go (and OS contributing) so I might not succeed. At first read it looked like you had figured out the solution and just needed someone to do the leg work which is why I thought it looked doable.
I'll definitely check in before submitting any code.
Thanks,

I'm very new to Go (and OS contributing) so I might not succeed.

No problem, that's completely acceptable. Even if you don't succeed, you'll have tried, perhaps learned something, and maybe will succeed in the end. If you only start things you know you'll succeed, you won't be able to start many things.

At first read it looked like you had figured out the solution

On the contrary, I gave it a shot, and had a rough prototype, but see the TODOs, many of them are "figure out the general high-level approach", etc. So figuring out the exact plan is still a task to be done.

I'll definitely check in before submitting any code.

Sounds great!

Thank you for your encouragement.
I take your point though, this is proving harder than I thought. I'm going to keep trying but I wouldn't suggest anyone hold their breath for my fix.
Really, thank you.

This would be a great PR for any new contributor to this repo or a new Go developer.
All contributions are greatly appreciated!
Feel free to volunteer for any issue and the issue can be assigned to you so that others don't attempt to duplicate the work.
Please check out our CONTRIBUTING.md guide to get started. (In particular, please remember to go generate ./... and don't use force-push to your PRs.)
Thank you!

Hi @gmlewis. I would like to give this issue a try

Hi @gmlewis. I would like to give this issue a try

Thank you, @sagar23sj , it is yours.

Hi @gmlewis and @dmitshur, Could you please let me know this issue has solved or updated? I would like to work on this issue!! Thank you!

@VUHAILAM - this issue is yours. Thank you!

Hi @dmitshur , my this problem understanding that  we have a function testType which helps to verify the live Github API data types and self-define data types. And when unmarshalling  to map, some fields are missed because omitempty option.
I have some questions:
Should we need to identify and ensure data fields of nested structs?
And Could you please provide me some encoding/json rules examples in go-github ?
Thank you!!

@VUHAILAM - I'm not sure why I ever labeled this as a "good first issue"... that was a mistake.
Looking back at the comments, Dmitri says above that this is a hard issue, and if you wish to withdraw, I'll remove your name from the issue.

@gmlewis I think we should break down this issue. I prepared some code can help to solve for the general data types in go-github.
`func getMapJsonKeyName(typ interface{}) map[string]interface{} {
var structType reflect.Type
if isSlice := reflect.Indirect(reflect.ValueOf(typ)).Kind() == reflect.Slice; isSlice {
structType = reflect.Indirect(reflect.ValueOf(typ)).Index(0).Type()
} else {
structType = reflect.Indirect(reflect.ValueOf(typ)).Type()
}
fieldsMap := make(map[string]interface{})

for i := 0; i < structType.NumField(); i++ {
	name, ok := getJsonKeyName(structType.Field(i))
	if !ok {
		continue
	}

	if structType.Field(i).Type().Kind() == reflect.Struct {
		fieldsMap[name] = getMapJsonKeyName(structType.Field(i).Type())
	} else {
		fieldsMap[name] = struct{}{}
	}
}
return fieldsMap

}
func compareFieldsMap(m1 map[string]interface{}, fieldsMap map[string]interface{}, typ interface{}) {
for k, v := range m1 {
if *skipURLs && strings.HasSuffix(k, "_url") {
continue
}
if _, ok := fieldsMap[k]; !ok {
fmt.Printf("%v missing field for key: %v (example value: %v)\n", reflect.TypeOf(typ), k, v)
} else {
if reflect.ValueOf(v).Kind() == reflect.Map {
compareFieldsMap(v.(map[string]interface{}), fieldsMap[k].(map[string]interface{}), typ)
}
}
}
}
func getJsonKeyName(field reflect.StructField) (string, bool) {
if !field.IsExported() && !field.Anonymous {
return "", false
}
tag, ok := field.Tag.Lookup("json")
if !ok {
	return field.Name, true
}

if tag == "-" {
	return "", false
}

name := strings.Split(tag, ",")[0]
if name == "" {
	return "", false
}

return name, true

}`
Could you please guilde me the next step. I think I can work on it or at least I can solve the basic of this issue. Thank you!!

I won't be able to dig deep into this issue until at least the beginning of the new year. It is a 5-year-old issue and is probably not a very high priority, so I would say to give it your best shot and report your findings to hopefully move the issue forward somewhat. Thanks.


Random seed should be random in production

https://github.com/Australian-Structural-Biology-Computing/proteinfold/blob/8ce05982ff57ba3722c4e87093307b68f9923d43/modules/local/run_alphafold2.nf#L67C23-L67C28
Should be truly random as each 5 models on 5 trained networks need to explore different starting areas of the NN parameter space.
We can keep 53343 as a magic number for debugging purposes and new hardware (tell M. Grogan)?

https://github.com/Australian-Structural-Biology-Computing/proteinfold/blob/8ce05982ff57ba3722c4e87093307b68f9923d43/modules/local/run_alphafold2_pred.nf#L49C1-L49C30
Occurs in _pred as well.

Fixed in #df3b0cdd2b40984e9c0a79a57fecd8e91b90312d and 7e753ad05f39abea71923065c366ff81cf7695a6.
Will run tests and open pull request


Doesn't handle HTML character entities

Newsboat version:
System: Linux 4.18.14-arch1-1-ARCH (x86_64)
Compiler: g++ 8.2.1 20180831
ncurses: ncurses 6.1.20180127 (compiled with 6.1)
libcurl: libcurl/7.61.1 OpenSSL/1.1.1 zlib/1.2.11 libidn2/2.0.5 libpsl/0.20.2 (+libidn2/2.0.4) libssh2/1.8.0 nghttp2/1.34.0 (compiled with 7.61.1)
SQLite: 3.25.2 (compiled with 3.25.2)
libxml2: compiled with 2.9.8

I follow Eric S. Raymond's blog and I was really confused as to how certain characters show up in his blog and not in my feed.  Turns out, all of the single quote characters are written as HTML character entities. So rather than writing I'm in the feed, it actually is written as I’m, which newsboat doesn't want to show.  Is there any reason as to why this is there?  And is it something that can be fixed?

I can't reproduce this on my end on 2.13, quotes display as they're supposed to.
What version are you running? You included the versions of all the libraries but not newsboats itself.

Guess I forgot to include that in my comment  I'm also using 2.13.

I've mulled it over a bit and I have an idea.  Does newsboat turn those character codes into UTF-8 characters?  If that's the case then the problem might be with my terminal emulator.

’ is the unicode apostrophe so it's indeed UTF-8

I just used a couple of diferent fonts to see if that was the issue, but the problem still persists.  So it's either my terminal or a bug.  Hope it's the former.

Also, as far as my configuration is go, there's nothing there but key binding changes and setting my browser.

if the characters are completely missing, it might be a problem with iconv or your locale—if you have a non-Unicode locale, iconv may fail to convert apostrophes into a valid codepoint, and might drop them. (I'm not entirely sure, I think it might try to replace them with something first, which should work for apostrophes because they can be replaced with single quotes.)
I also confirm that I have Newsboat 2.13 working in Xterm (with no configuration), URXvt (with Hack font and +sb -rv options), and xfce4-terminal (with Hack font and colour palette settings that shouldn't affect apostrophes). In all cases, my locale is en_GB.utf8, though I used to run with en_US.utf8 and it worked fine too.

if the characters are completely missing, it might be a problem with iconv or your locale—if you have a non-Unicode locale, iconv may fail to convert apostrophes into a valid codepoint, and might drop them. (I'm not entirely sure, I think it might try to replace them with something first, which should work for apostrophes because they can be replaced with single quotes.)
I also confirm that I have Newsboat 2.13 working in Xterm (with no configuration), URXvt (with Hack font and +sb -rv options), and xfce4-terminal (with Hack font and colour palette settings that shouldn't affect apostrophes). In all cases, my locale is en_GB.utf8, though I used to run with en_US.utf8 and it worked fine too.

That was it!  Thanks for the help.

@rasputin-machine How did you manage to fix this problem? I can't get newsboat to display apostrophes correctly on st with monospace font

@Mati20187, I believe @rasputin-machine had problems with articles' bodies, not titles. The issue you're describing is a duplicate of #202. I suggest you show this report to the feed's publisher and ask them to improve the feed for better interoperability.


fix a thread-safety bug in the UFF parameter loading

The way we were using the singleton here was, I think, not particularly threadsafe. This might have been leading to a Heisenbug in the KNIME nodes.
The changes here outsource worrying about thread-safe initialization to boost::flyweight (yay!).
I didn't add any new tests because we're already doing current multi-threaded UFF and conformer generation (this also uses UFF parameters) tests. Those weren't showing any problem and I didn't manage to come up with anything that would reproducibly show the problem.

@ptosco : this one is pretty short, would you mind reviewing it?


chore/build: update to Rust nightly 2017-04-28, Clippy 0.0.128 and Rustfmt 0.8.3

r? @dirvine
(maidsafe_highfive has picked a reviewer for you, use r? to override)


Added RSS link

I followed the instructions reported at https://gohugo.io/templates/rss/

Thank you!


set save_index default value to False instead of True

save method on SimilarityModel should have default value for save_index set to False instead of True. At the current state functions that accept the model as input and internally call the save method can fail because of the incompatible behavior with other models with default args

Synced up offline and we will keep the flag, but we need to do a better job of surfacing errors and saving the model without any index shouldn't through an error.


Configuring messages sent into the RabbitMQ CRDs to be Persistent

Changes

🎁 Configuring messages sent into the RabbitMQ CRDs to be Persistent

/kind bug

Fixes #546

Release Note

- Configuring messages sent into the RabbitMQ Broker's to be persistent as the Queues used by the Broker's are always durable
- Now if the user set the configuration of the RabbitMQ Source Exchange and Queue to be durable the messages are also durable

Docs

/lgtm
/approve


How to deny to renew token id by acquireTokenSilent() and force it to redirect login

Library

[ ]<EMAIL_ADDRESS>
Description
In my web app, I authenticate user login via azure b2c. I use msal angular with scope openid and add MsalGuard, MsalInterceptor to acquire token silently, then my token is expired, msal will renew token id.
In my web api, I implement an api using Microsolft Graph .Net Client to deny renew token id silently, force it to redirect login.
I researched about invalidateallrefreshtokens function using Microsolft Graph .Net Client but not work.
Anyone can tell me how to deny renew token id silently, force it to redirect login?
Thanks a lot.

@azure/msal-angular and @azure/msal-core implement the implicit flow, outlined by the OAuth spec, which does not use refresh tokens--this is probably why something like invalidateAllRefreshTokens does not work with our library.
You can try using prompt: "login" in your msal config to always force logins instead of silent ones.

Thank you @jmckennon

One more thing @jmckennon what happens if I use scope offline_access for msal config as following here?

offline_access shouldn't have an effect at all when using msal-angular, as again, it uses the implicit flow which does not deal with refresh tokens.

Closing this as we're assuming the problem is solved due to inactivity. Please open a new issue if you gave further questions. Thanks!


Populating Workspace issue

I am using NTLM for on-prem sp 2016, populate the local workspace continuously running. No error and nothing happening. The notification shows multiple instances of "Populating workspaces". Any thoughts on this?
Issue:
Nothing happening when I try to populate the workspace
"publishingScope": "SaveOnly",
"authenticationType": "NTLM",
"remoteFolders": [
    "/Style Library/eboardScripts/cScripts"
]

In  VS code notification, I am seeing so many "Populating workspace" running.
Expected:  It should populate files from the on-prem sp 2016 site.
Note: I have VS code on my desktop but SharePoint deployed in a VM. I am trying to connect to a non-development environment. Configuration worked fine and .json file created but when I try to populate folder from that site I get nothing. I am the owner of that site. Not sure what went wrong!

Hello @kalaram20
Sorry for the long delay. I’ve seen a couple other users with NTLM problems lately, so there must be something going on.
Are there any messages in the SPGo output logs?
If you are able, I would also ask you to open the VSCode debug console and record any errors you se there for me.
Thanks for using SPGo. I hope we can get this resolved quickly!

Hello @kalaram20. Are you still seeing this issue?

I'm closing this issue due to age. Please reopen if you are still experiencing the issue.

I'm closing this issue due to age. Please reopen if you are still experiencing the issue.


Automated cherry pick of #126

Cherry pick of #126 on release-0.1.
#126: Consistent use of glog

/assign

/hold

/unhold

/joke

/hold
/approve


PhonePe Clone added

Closes: #314

Title :  Phonepe Clone
Name: : Damini Chachane
Idenitfy yourself: : GSSOC

Describe the add-ons or changes you've made 📃
How Has This Been Tested? ⚙

Screenshots 📷

Type of change ☑

What sort of change have you made:

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Code style update (formatting, local variables)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist: ☑

[x] My code follows the Contributing Guidelines & Code of Conduct of this project.
[x] This PR does not contain plagiarized content.
[x] I have performed a self-review of my own code.
[x] I have commented my code, particularly wherever it was hard to understand.
[x] My changes generate no new warnings.

Note to reviewers 📄

@Avdhesh-Varshney Kindly review this PR and increase the Level.

@Damini2004 don't do un-necessary changes and avoid this large sequence of commits


Java Error even when I have JRE Installed

After I updated my OS X protractor stopped working.
Here is what I get:
To view this web content, you need to install the Java Runtime Environment.

Is java available on your command line path?

I had JRE but didn't have JDK. I needed to install JDK again after upgrading my OS X. This issue was resolved by installing JDK.

Thank you mohsen1, that fixed it for me too!


MelWeightMatrix

Onnx Docu
For folks (like me) who are new to Mel Spectrogram in audio signal processing here's a link that helped me get some context.
On searching for associated torchaudio Ops, I found that there is a MelScale Op in torchaudio.transforms that converts an STFT to a mel scaled STFT ( which is sort of what the MelWeightMatrix is supposed to do after we create it).
Looking at the source for MelScale, it's a matmul (+ some transposes to align everything) between the input STFT with the melscale_fbanks matrix which is what we expect from onnx.MelWeightMatrix
So there is almost a 1:1 mapping from onnx.MelWeightMatrix to melscale_fbanks

onnx
torch
Comment

num_mel_bins
n_mels

dft_length
n_freqs
n_freqs will need to passed as floor(dft_length/2)+1 as that is the expected output size

sample_rate
sample_rate

lower_edge_hertz
f_min
both in Hz

upper_edge_hertz
f_max
both in Hz

-
norm
use torch default

-
mel_scale
use torch default

attr: output_type
-
depends on input so if attr is set in onnx would need to be handled explicitly

One thing to note when actually using in a model is
that onnx.MelWeightMatrix requires :

In the returned matrix, all the triangles (filterbanks) have a peak value of 1.0.

Whereas melscale_fbanks notes that :

For the sake of the numerical compatibility with librosa, not all the coefficients in the resulting filter bank has magnitude of 1.

https://github.com/llvm/torch-mlir/pull/3503


Whitespace fixes

Movement of println's in one bit of code caused regressions in
the display of other bits of code.

r=me


boards: arm: Add steval_fcu001v1 board support

Add the BSP for STEVAL_FCU001V1 board with documentation.
Signed-off-by: NavinSankar Velliangiri<EMAIL_ADDRESS>

Some checks haven't started yet.  @ioannisg

@erwango PR is closed by my mistake. Please re-open it

@Navin-Sankar can't do, sorry. Maybe @ioannisg / @galak ?

@ioannisg @galak PR is closed by my mistake. Please re-open it.

@ioannisg @galak Please re-open the PR.

@Navin-Sankar, for some reason we're not able to reopen this PR. Can you check if you have the ability to do it ? Otherwise please raise a new PR an we resume works where we stopped.

Is the branch deleted?


Introduce preferDaemon option in order to use non-daemon mypy on purpose

Close #115
Change Overview

I introduced preferDaemon  option, which would be equivalent to Christian(@cpnielsen)'s suggestion. I guess "prefer" would be a bit less surprising because this option may be ignored.
This change needed a more careful distinction between daemon and non-daemon, which was previously partially implemented in _log_version_info. I introduced MypyInfo class and refactored related functions.

Manual Tests

[x] python -m nox --session tests
[x] python -m nox --session lint
[x] Invoke Debug Extension and Python; open a workspace with "mypy-type-checker.preferDaemon": true; save a python file with a: int = "1"; see the extension publish an error; change the line to a: int = 1 and save it; see the error vanish;
[x] Check the above with "mypy-type-checker.preferDaemon": false.

@microsoft-github-policy-service agree

Looks solid, so happy to see someone tackle it 🙏

I realized that the lint didn't pass. Actually isort --check --diff suggests the following two-line format, but black rejects it.
--- C:\Users\hugov\Documents\vscode-mypy\src\test\python_tests\test_non_daemon.py:before        2023-09-10 03:35:20.665794
+++ C:\Users\hugov\Documents\vscode-mypy\src\test\python_tests\test_non_daemon.py:after 2023-09-10 03:36:42.968672
@@ -2,18 +2,10 @@
 from threading import Event
 from typing import Any, Dict, List

-from hamcrest import (
-    assert_that,
-    contains_string,
-    greater_than,
-    has_item,
-    has_length,
-    is_,
-    not_,
-)
+from hamcrest import (assert_that, contains_string, greater_than, has_item,
+                      has_length, is_, not_)

 from .lsp_test_client import constants, defaults, session, utils
-

Adding --profile black option to isort (009c302fe801a2e48581b6916ab63ad61e1e4a66) resolved all.

Closing and re-opening to trigger cla check.

@karthiknadig Any chance of a release soon? 🙏

@cpnielsen This is in pre-release. For large changes like this we keep it in pre-release for a few weeks. The next stable release with this change will likely be in the first week of october.

@karthiknadig At the chance of sounding like a broken record, any updates? 🙏
I have been using this exclusively with the pre-release version and have had no issues.

This is published now.


Trying to build SDB with AppVeyor

@radare please also enable webhook for SDB: https://ci.appveyor.com/api/github/webhook?id=h8nhvvulcu8t8m5x

Nice. Thanks!

On 8 Mar 2019, at 12:10, Anton Kochkov<EMAIL_ADDRESS>wrote:
@radare please also enable webhook for SDB: https://ci.appveyor.com/api/github/webhook?id=h8nhvvulcu8t8m5x
You can view, comment on, or merge this pull request online at:
https://github.com/radare/sdb/pull/189
Commit Summary
Trying to build SDB with AppVeyor
File Changes
M .appveyor.yml (15)
Patch Links:
https://github.com/radare/sdb/pull/189.patch
https://github.com/radare/sdb/pull/189.diff
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.


Derive SpendSeed from seed phrase

Our SpendSeed is currently generated randomly. We should instead derive the SpendSeed from a series of randomly generated words as described in BIP39 since it's easier to remember English words. Users then just need to remember the seed phrase. This would require changes to SpendKey::generate in the crypto crate as well as changes to the pcli wallet commands (e.g. to import from a seed phrase instead of the spend seed).
A recommended wordlist: https://github.com/bitcoin/bips/blob/master/bip-0039/english.txt

Two things we should consider when doing this:

We should add an intermediate level of derivation, so that we can derive multiple spending authorities from a single seed.  (Use case: there's one viewing authority per spending authority, and it would be useful to allow the possibility of creating multiple viewing authorities from the same seed phrase).

We should ensure that the BIP32 derivation we do is compatible with what we'd need for ledger support.


standalone/io/wait_for_test is failing

--- Command "dart2analyzer" (took 27ms):
DART_CONFIGURATION=ReleaseX64NNBD out/ReleaseX64NNBD/dart-sdk/bin/dartanalyzer --enable-experiment=non-nullable --ignore-unrecognized-flags --packages=/b/s/w/ir/cache/builder/sdk/.packages --format=machine --no-hints /b/s/w/ir/cache/builder/sdk/tests/standalone/io/wait_for_test.dart

exit code:
1

stderr:
ERROR|STATIC_TYPE_WARNING|INVALID_ASSIGNMENT|/b/s/w/ir/cache/builder/sdk/tests/standalone/io/wait_for_test.dart|19|17|23|A value of type 'bool?' can't be assigned to a variable of type 'bool'.

--- Re-run this test:
python tools/test.py -n analyzer-asserts-strong-linux standalone/io/wait_for_test

The error seems right to me.
If waitFor returns nullable, we cannot assign it to non-nullable bool.
  bool result = waitFor<bool>(c.future);

@a-siva It was your change https://github.com/dart-lang/sdk/commit/0e5a7275d0cd261af66cb104c058c8968d27fc3e that broke it.

Let me take a look.

https://dart-review.googlesource.com/c/sdk/+/134565 should fix it.


python312Packages.sisyphus-control: 3.1.3 -> 3.1.4

Description of changes
Diff: https://github.com/jkeljo/sisyphus-control/compare/refs/tags/v3.1.3...v3.1.4
Changelog: https://github.com/jkeljo/sisyphus-control/blob/v3.1.4/CHANGELOG.rst

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

Result of nixpkgs-review pr 338551 run on x86_64-linux 1

4 packages built:

python311Packages.sisyphus-control
python311Packages.sisyphus-control.dist
python312Packages.sisyphus-control
python312Packages.sisyphus-control.dist


Experiment with Code Spaces and related tooling

We try to make it as easy as possible to contribute to the project. One of the current tools to explore are Github codespaces, along with docker/docker-compose to make this easy. This ticket is to track research and experimentation around this.

👋 Codespaces team member here, I am going to take a look at getting a dev container configured with the repo's startup steps!

Hi, I have some experience with codespaces. I would like to contribute a devcontainer that will help new users get started.

@aeisenberg give it a shot!

Thanks. I'm giving it a shot and I have something that I think works. With my change, you can create a codespace and after initialization completes, you have the correct ruby version installed, postgres available, and rails setup. All you need to do is call bin/start.
The downside is that there are no pre-built docker images for Ruby 3.2.2 right now since the latest is 3.2.3. This means that before the container can be initialized, we must download and compile 3.2.2. This takes a while. I'll put up what I have after I clean it up a bit, but I'd like some guidance on how to make this better.

I spoke too soon (or typed too soon). I found an image that provides 3.2.2 by default. This significantly speeds up the codespace startup. However, when you move to a new version of ruby, we'll need to update the image as well. I'll put that in the README.

PR created. I hope this will be useful for you. I wanted to work on this because when I tried to set up the project myself, I had trouble getting the dev environment correct. With this change, it should be one-click to get a working environment (though it will take a little time).
When the ruby version changes, it would be nice (but not necessary) to also update the docker image.

I'm still working on this and getting feedback on #4292. Can someone reassign me?

Still working on this. 😄 Can you reassign?

Done.

Will be fixed by https://github.com/rubyforgood/human-essentials/pull/4353

Hello there! It's great to see the improvements in action. I managed to run the project within the codespace environment. Kudos to @aeisenberg and @awwaiid for the accessibility enhancements! 👏
I'm here because last week (before those codespace changes), I was going through the documentation and trying to set up the project locally to contribute. At that time, the only method I found was to manually install Ruby and Postgres, along with all the required libraries, Bundler, rbenv/rvm, XCode's command line tools, homebrew, etc...
However, I managed to containerize the project to run with Docker Compose. This provides another convenient way to contribute, as it allows setting up and running the application without any environment configuration. The only requirements are Docker and Docker Compose installed on your machine.
That being said, do you still think it's worth Dockerizing the project? If that's the case, can I work on it?

Heh... this is a perennial request. We've had it before and actually removed it.
For some more history and context, see https://github.com/rubyforgood/human-essentials/pull/3781#issuecomment-1986459292 and more importantly https://github.com/rubyforgood/human-essentials/issues/1856#issuecomment-695344747 .
@awwaiid is this issue OK to close since we merged the codespaces stuff?


Bitwise Operator Or issue

From @sergeyklay on August 15, 2015 19:31
php works fine
$a = 16;
$a |= $a >> 1; // 24
// the same as
// $a = $a | ($a >> 1);

zephir throws Zephir\ParseException with "Syntax error" message
var a;

let a = 16;
let a |= a >> 1;

Syntax error in /tmp/foo/foo/bar.zep on line 33

            let a |= a >> 1;
    --------------^

works fine
var a;

let a = 16;
let a = a | (a >> 1);

Want to back this issue? Post a bounty on it! We accept bounties via Bountysource.

Copied from original issue: phalcon/zephir#1056

From @ovr on August 18, 2015 7:59
It's not implemented in parser


Dragging selection points outside map

Hi @JamesLMilner I have a set of issues I will post individually, hope you are doing well.
Currently there's a validation of the features position to keep them inside the lat and lng range. This is being done when you drag the whole feature, but it is possible to drag a single vertex of a feature (selection point) outside this boundaries.

Thanks @alanOracle
Resolved in 0.0.1-alpha.44. Long term it would be nice to have better handling of antimeridian crossings.


implement uv pip config

I've been searching in the uv docs and issue-tracker, but I did not find my answer.
Apologies if I overlooked something.
As a pip-user, I  regularly use  "pip config list" to display the config pip is actually seeing.
see https://pip.pypa.io/en/stable/cli/pip_config/
Questions:

is there currently a way to see what config uv is actually using (after merging several sources)?
is there a plan to implement something like "pip config"

Usecase
I'm currently  troubleshooting why an (private) index-url in pyproject.toml does not have any effect:
[tool.uv]
# see https://docs.astral.sh/uv/reference/settings/
index-url =<EMAIL_ADDRESS>

uv --version
0.4.15

Similar case, I couldn't manage to set an self-hosted pypi repository. This pushed me back to poetry
Unfortunately I cannot share logs as it is company related, but back your issue up

Hi @zanieb, could this use a stable serialization format for ease of use with a deserializer? Something like TOML or RON, perhaps?


Add a glossary

Problem Statement

There's some terminology that may be confusing to new users and it needs to be easy to find the definition of it.
Proposed Solution

Add a glossary
Alternatives Considered

https://pydata-sphinx-theme.readthedocs.io/en/stable/demo/kitchen-sink/paragraph-markup.html?highlight=glossary#glossary

Glossary
--------

This is a glossary with definition terms for things like :term:`Writing`:

.. glossary::

  Documentation
     Provides users with the knowledge they need to use something.

  Reading
     The process of taking information into ones mind through the use of eyes.

  Writing
     The process of putting thoughts into a medium for other people to :term:`read <Reading>`.

Proposed Action Plan

[ ] 1. we'll do this
[ ] 2. We'll do that
[ ] 3. Then we'll add tests for this and that.

Do you mind elaborating on the project?

Do you mind elaborating on the project?

I added some additional details to the issue.  Let me know if you have any specific questions.