Feature: Position/Keyword Args with SQL

Description
Implement the ability to use positional/keyword args with sql. Because of the differences between python and rust, the function arguments need to be clearly implemented.
The pyspark process for sql allows for literals and dataframes to be in one argument. However, rust probably won't take to kindly to that input arg. If a user passes in a DataFrame it will need to be handled with a SubqueryAlias and if it's a literal it will be passed in as either a positional or a keyword argument.
We might want to only allow for to inputs parameters are options. Something like this?
sql<T: ToLiteral>(self, sql_query: &str, col_args: Option<HashMap<String, T>>, df_args: Option<HashMap<String, DataFrame>>) -> DataFrame

This could allow a user to do these variations.
spark.sql("SELECT * FROM table", None, None).await?;

let df = spark.range(...);

// create the hashmap

spark.sql("SELECT * FROM {df}" None, Some(df_hashmap)).await?;

let col = "name";

// create the hashmap

spark.sql("SELECT {col} FROM {df}", Some(col_hashmap), Some(df_hashmap)).await?;

Or should positional SQL be a completely different method all together? like sql_params? So that a user doesn't need to fuss with adding None x2 to all their sql statements.

The majority of the stuff is probably covered in a format! similar macro, or format_args! some of the other ones with direct DF objects in place may get a bit strange there, but the simple value ones should be easy to do with format and nothing else.

I’ve haven’t had the time to code it up, but I’m interested in creating a macro like sql! which will handle this. But it’ll also perform similar to what you’d find with the sqlx query! macro that performs validation at compile time.
It would be interesting to have your sql transformation validated by the compiler. I feel like it could be a helpful feature.

Can I take this? I want to try to make the sql! macro.

@abrassel go for it!

@sjrusso8 what do you think about the macro transforming it's input string into spark SQL core classes before sending it? I'm not sure if it's possible to send a raw string, but this would be one way to parse and compile time correct SQL strings.


DoS vulnerability: adapter-node crashes with malformed URI

Describe the bug
Using the latest version of SvelteKit and adatper-node, a malformed URI causes the node process to crash.
We recently encountered this in production on the tradingstrategy.ai.
We implemented a work-around by creating a server.js wrapper and calling the handler function exported by adapter-node. We first tried wrapping handler in a try/catch … this didn't work / the server still crashed. We ended up manually calling decodeURI() in a try/catch to detect the error before calling handler.
I am open to working on a PR for this. There appears to be a test that would catch this issue, but the test setup appears to be broken. If you can advise me on how to get tests working, I can confirm that this test fails and work on a solution.
Reproduction
This is trivial to reproduce with a vanilla SvelteKit app using adapter-node, so in lieu of a repro repo, here are simple steps to recreate…
1. Create vanilla SvelteKit app with adapter-node
Select the most vanilla options: Skeleton, None, No, No, No
npm init svelte adapter-node-crash
cd adapter-node-crash
perl -pi -e 's/adapter-auto/adapter-node/' package.json svelte.config.js
npm install

2. Build and preview
npm run build
npm run preview

3. Hit it with some malformed URIs
3.a. Simple invalid URI
curl http://localhost:3000//

See server logs below.
3.b. Invalid encoded value
curl http://localhost:3000/%CD

See server logs below.
Logs
# 3.a. Simple invalid URI

node:internal/url:553
  throw new ERR_INVALID_URL(input);
  ^

TypeError [ERR_INVALID_URL]: Invalid URL
    at new NodeError (node:internal/errors:372:5)
    at URL.onParseError (node:internal/url:553:9)
    at new URL (node:internal/url:629:5)
    at file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/index5.js:94:25
    at next (file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/index5.js:229:5)
    at file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/index5.js:229:29
    at file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/constants.js:642:28
    at next (file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/index5.js:229:5)
    at file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/index5.js:229:29
    at file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/constants.js:642:28 {
  input: '//',
  code: 'ERR_INVALID_URL'
}

# 3.b. Invalid encoded value

file:///Users/ken/Code/tradingstrategy/adapter-node-repro/.svelte-kit/output/server/index.js:2022
  let decoded = decodeURI(url.pathname);
                ^

URIError: URI malformed
    at decodeURI (<anonymous>)
    at respond (file:///Users/ken/Code/tradingstrategy/adapter-node-repro/.svelte-kit/output/server/index.js:2022:17)
    at Server.respond (file:///Users/ken/Code/tradingstrategy/adapter-node-repro/.svelte-kit/output/server/index.js:2293:12)
    at async file:///Users/ken/Code/tradingstrategy/adapter-node-repro/node_modules/@sveltejs/kit/dist/chunks/index5.js:161:5

System Info
System:
    OS: macOS 12.3.1
    CPU: (10) arm64 Apple M1 Pro
    Memory: 79.53 MB / 16.00 GB
    Shell: 5.8 - /bin/zsh
  Binaries:
    Node: 16.15.0 - ~/.nvm/versions/node/v16.15.0/bin/node
    Yarn: 1.22.15 - ~/.nvm/versions/node/v16.15.0/bin/yarn
    npm: 8.5.5 - ~/.nvm/versions/node/v16.15.0/bin/npm
  Browsers:
    Brave Browser: <IP_ADDRESS>
    Chrome: 102.0.5005.61
    Firefox: 100.0.2
    Safari: 15.4
  npmPackages:
    @sveltejs/adapter-node: next => 1.0.0-next.76
    @sveltejs/kit: next => 1.0.0-next.345
    svelte: ^3.44.0 => 3.48.0

Severity
serious, but I can work around it
Additional Information
This seems to be a regression of something that worked in the past. See:

https://github.com/sveltejs/kit/blob/master/packages/adapter-node/tests/smoke.js#L64-L69
#2532
#2533

Any feedback on this? This defect exposes a trivial DoS vulnerability, so I think it warrants some attention. As I mentioned above, I'd be happy to work on a PR to address this if someone can advise me on how to get tests working.
For others experiencing this issue in production, I wanted to share how we are mitigating this until it is fixed in the adapter:
https://github.com/tradingstrategy-ai/frontend/pull/107/files

I can't reproduce this with the actual production output with the Node adapter (what you would get when running node build/index.js after building). I do see it happening with preview, as noted in the original issue description.
If this is only affecting preview, then it's still something we should get fixed, but it doesn't seem critical. preview doesn't actually run an adapter version of your app (what's run is the same regardless of which adapter you're using), and it's really not what you should be running in production.

Ah, I see there were two different requests mentioned in the OP. Yes, curl http://localhost:3000/%CD does crash the real production Node-adapted output app for me. (curl http://localhost:3000// only crashed the preview app.)

@Conduitry good point – I had not noticed the difference between preview and node build/index.js in my own testing. We knew this was breaking for us in prod with the second/malformed URI (where we were correctly starting the service with node build/index.js), so I guess when I saw it break with preview I assumed the behavior was the same.

The preview issue is another instance of the paths beginning with // being treated as a protocol-relative URL, and then new URL fails when there's no protocol. It looks like that part can be handled with
diff --git a/packages/kit/src/core/preview/index.js b/packages/kit/src/core/preview/index.js
index 90adb401..2ff58e4d 100644
--- a/packages/kit/src/core/preview/index.js
+++ b/packages/kit/src/core/preview/index.js
@@ -78,7 +78,7 @@ export async function preview({ port, host, https: use_https = false }) {

 		(req, res, next) => {
 			const original_url = /** @type {string} */ (req.url);
-			const { pathname } = new URL(original_url, 'http://dummy');
+			const { pathname } = new URL('http://dummy' + original_url);

 			if (pathname.startsWith(base)) {
 				next();
@@ -106,7 +106,8 @@ export async function preview({ port, host, https: use_https = false }) {
 				return;
 			}

-			const { pathname } = new URL(/** @type {string} */ (req.url), 'http://dummy');
+			const original_url = /** @type {string} */ (req.url);
+			const { pathname } = new URL('http://dummy' + original_url);

 			// only treat this as a page if it doesn't include an extension
 			if (pathname === '/' || /\/[^./]+\/?$/.test(pathname)) {

The more serious issue - the one with the built production app - is coming from an exception thrown at https://github.com/sveltejs/kit/blob/36ebe27874e865d24bca84530e795ce4909c0f8b/packages/kit/src/runtime/server/index.js#L44
Presumably we should be trying to catch an error here and just returning a 400 instead.

Makes sense! I'd be happy to submit a PR for this, but I'd prefer to first see a failing test first & then make it pass. Any insight on how to get tests working for adapter-node?

Hi @benmccann – just tested preview and confirmed it no longer crashes with curl http://localhost:3000//. It does still crash with malformed encoded URI. Not sure if this is a concern for preview as no one should be running this in prod.
No change when running with node build/index.js – still crashing with malformed encoded URI (but not with //).

Nothing is crashing for me with the latest versions of everything, either in preview or production, for // and /%CD — I think it's now safe to close this issue

Verified based on latest versions – LGTM 👍.


ANKSigned as Numeric vs BinaryInteger

Having thought about it quite a bit, I have come to the conclusion that ANKSigned should conform to SignedNumeric rather than the more specific SingedInteger protocol. The main reason being that SignedInteger requires 2's complementsemantics, playing to the model's weaknesses as opposed to it's strengths. This bet on weakness gets further compounded by conforming to FixedWidthInteger as overflow happens at different values in sign+magnitude and 2's complement. I feel like shoehorning ANKSigned into 2's complement just leaves you with an api that you do not want to use over any actual 2's complement integer, like, ever.
Also, one of the main reasons for conforming to BinaryInteger in the first place is to perform conversions, but I think this can be achieved regardless with a few extensions. It may even be possible to extend generically over ANKSigned<T>, but I'm not convinced that any T other than Magnitude is actually useful.
extension BinaryInteger {
    init(_ source: ANKSigned<Magnitude>)
    init?(exactly source: ANKSigned<Magnitude>)
    init(clamping source: ANKSigned<Magnitude>)
    init(truncatingIfNeeded source: ANKSigned<Magnitude>)
}

If BinaryInteger can be extended in a satisfactory way then ANKFullWidthKit should also decouple from ANKSignedKit.

Another option I’m intrigued about is promoting the core of ANKSigned to ANKFoundation, and keeping its numeric operations in ANKSignedKit. Without importing ANKSignedKit it is essentially a premium sign-magnitude tuple having access to isNormal and normalized to check for negative zero. The benefit of this approach is that ANKBinaryInteger can then include the following requirements (allowing init(clamping:) to be used on non-fixed-width integers):
protocol ANKBinaryInteger {
    init(_ source: Singed<Magnitude>)
    init?(exactly source: Singed<Magnitude>)
    init(clamping source: Singed<Magnitude>)
    init(truncatingIfNeeded source: Singed<Magnitude>)
}

Yet another option is to add require the following methods. The appeal being that it solves the problem mentioned in #11. In contrast to the previous method it also lets me demote ANKSign(ed) to ANKSignedKit, since ANKSigned can forward itself to those methods from inside ANKSignedKit.
extension ANKBinaryInteger {
    init(magnitude source: Magnitude, uncheckedIsLessThanZero: Bool)
    init?(exactlyAsMagnitude: Magnitude, uncheckedIsLessThanZero: Bool)
    init(clampingAsMagnitude: Magnitude, uncheckedIsLessThanZero: Bool)
    init(truncatingIfNeededAsMagnitude: Magnitude, uncheckedIsLessThanZero: Bool)
}

It turns out that the above initializer does not solve #11 because I glossed over some details about the problem. As is the case, I suppose I will try the promoted implementation because it contains less noise. I may also promote ANKFullWidth to ANKFoundation for symmetry.

I suppose nice bit width + 1 bit == bad bit width for bit manipulation.

The above statement is the biggest realization, tbh. I imagine SignMagnitude<BitPattern> would be a more reasonable BinaryInteger candidate. Although, I still think using foreign semantics is a weak play.


Wrong description on change this property

Wrong 1
You cannot change the value to false if there is data in the table in any of the companies.
Why?
Case 1
If you build a table with DataPerCompany = true, deploy it enter the same data in multiple (I tested 2) companies in this table, change DataPerCompany to false and deploy again it will, you will find the same records in this one table (shared by those 2 companies)
Case 2
Similar to Case 1, but you have in both companies a record in the table that is unique. When changing DataPerCompany to false and deploy again it will take the records from one of the companies (in my experiment it's always from the same company)
Wrong 2
You can only set this property to true if the table is empty in all companies, or if the table holds data in only one company.
Why?
It's already wrong on its own, because when changing to true means that it was false and thus was data shared by all companies.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 95c72414-f527-ffd9-3a53-d258bfda12e1
Version Independent ID: 978b84ad-7cab-b6e7-8ec6-b726126a98ab
Content: DataPerCompany Property - Business Central
Content Source: dev-itpro/developer/properties/devenv-datapercompany-property.md
Service: dynamics365-business-central
GitHub Login: @SusanneWindfeldPedersen
Microsoft Alias: solsen

Who's going to pick this up?

Nothing still?

And two years later nothing happened still.


How do I train RRDB_psnr_x4.pth with my own data?

How do I train RRDB_psnr_x4.pth with my own data?

Modify the training script train_ESRGAN.yml

hi，could you explain how to modify train_ESRGAN.yml? thx. @xinntao @qingfengmingyue


Includes new params within difference arr

Add function to detect when new params are present and a request updated is try. This change is requested to be introduced since zip function will truncate all those parameters that have no correspondence, so, new params will be lost and difference will remain with 0 length and updated_parameters_request to connect will be skipped.

Sorry, my bad. I added a file for a new mixin implementation but added it in the wrong commit. The file has been removed from this pull request.


Add Business Logic to Your Application

Tutorials: https://developers.sap.com/tutorials/btp-app-cap-business-logic.html
Hi,
In step 2, please explian how to reload this page. I finished the previous tutorial a couple of days ago, and now I cant't start the page out of the box with VS Code. It took me about 10 minutes to find out that I can run the cds watch command in my cpapp folder in Git Bash  in order to start the applocation. I then need to open http://localhost:4004/risks/webapp/index.html to see the app in the browser. It would be much easier if this information is directly provided here.

Hi,
Closing as this was discussed in a call.
Best regards,
Mahati


Firebase plugins have analysis errors

Steps to Reproduce
mit-macbookpro2:firebase_auth mit$ ~/dev/github/flutter/bin/flutter analyze
Running "flutter packages get" in firebase_auth...    0.5s
Analyzing /Users/mit/dev/github/mit-plugins/packages/firebase_auth...
  error • Target of URI doesn't exist: 'package:google_sign_in/google_sign_in.dart' at example/lib/main.dart:10:8 • uri_does_not_exist
  error • Undefined class 'GoogleSignIn' at example/lib/main.dart:13:7 • undefined_class
  error • Undefined class 'GoogleSignIn' at example/lib/main.dart:13:40 • undefined_class
  error • Undefined class 'GoogleSignInAccount' at example/lib/main.dart:63:5 • undefined_class
  error • Undefined class 'GoogleSignInAuthentication' at example/lib/main.dart:64:5 • undefined_class
5 issues found.
(Ran in 6.0s)

mit-macbookpro2:firebase_database mit$ ~/dev/github/flutter/bin/flutter analyze
Analyzing /Users/mit/dev/github/mit-plugins/packages/firebase_database...
  error • Target of URI doesn't exist: 'package:firebase_auth/firebase_auth.dart' at example/lib/main.dart:8:8 • uri_does_not_exist
  error • Undefined name 'FirebaseAuth' at example/lib/main.dart:64:11 • undefined_identifier
2 issues found.
(Ran in 6.7s)

Never mind, the plugins don't actually require these dependencies do, and their pubspec's are already correct but due to https://github.com/flutter/flutter/issues/10015 we see these failures.


Batch wrapping at epoch boundries

Training set size is not always evenly divisible at batch boundries. One nice way to handle this issue is to "wrap" the batches -- mix samples from end of last epoch with samples from start of next epoch. This makes "every epoch" eval timing tricky. As long as we eval after the wrapped batch it is strictly worse from a work perspective. Is this acceptable?

I am not sure if this is widely used, but PyTorch has an option to drop the last batch if it is incomplete in their DataLoader class. Just to be clear, is drop_last=True allowed?

I'd assume this isn't legal because it reduces work. Starting the next
epoch is the same work. Thoughts?
On Tue, Oct 2, 2018 at 1:40 PM, codyaustun<EMAIL_ADDRESS>wrote:

I am not sure if this is widely used, but PyTorch has an option to drop
the last batch if it is incomplete in their DataLoader
https://pytorch.org/docs/stable/data.html#torch.utils.data.DataLoader
class. Just to be clear, is drop_last=True allowed?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/mlperf/policies/issues/93#issuecomment-426422132, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AhFaHU4TGyg1XLHzQqvoywLNEP2w2A3kks5ug89MgaJpZM4W7v99
.

I agree. I don't think it should be legal. The rules don't seem explicit about this, so it would be good to add a note.


ability to log messages and read them globally

I don't know if such a possibility exists and if not, it would be useful.
I run Arango transactions on multiple collections with multiple queries and I wonder if I could log something and read it in Arango logs.
db._executeTransaction({
  collections: { write: ['foo', 'bar', 'baz'] },
  action: (function () {
    console.log('begin');
    ...
    console.log('middle');
    ...
    console.log('end');
  }).toString(),
});

For now the only way is to throw exceptions like that:
db._executeTransaction({
  collections: { write: ['foo', 'bar', 'baz'] },
  action: (function () {
    ...
    throw JSON.stringify(foo);
    ...
  }).toString(),
});

I am not sure if I understand this.
The following should actually work so that messages will show up in the logs of arangod:
db._executeTransaction({
  collections: { write: ['foo', 'bar', 'baz'] },
  action: (function () {
    var console = require("console");
    console.log('begin');
    ...
    console.log('middle');
    ...
    console.log('end');
  }).toString(),
});

Is there any particular issue with that?

Thanks!!! It helped me a lot.


Porting and cleaning up Cardano.Mnemonic module (incl. corresponding tests)

Context

As part of this rewrite of the wallet backend, we do not want to depend on any of the code from cardano-sl; Yet, there are a few bits that were made in a fairly isolated manner that are still very relevant to the wallet This is the case of:
https://github.com/input-output-hk/cardano-sl/tree/develop/mnemonic
Minus a few bits that are strictly related to cardano-sl like:

https://github.com/input-output-hk/cardano-sl/blob/develop/mnemonic/src/Cardano/Mnemonic.hs#L155-L186
https://github.com/input-output-hk/cardano-sl/blob/develop/mnemonic/src/Cardano/Mnemonic.hs#L237-L240
https://github.com/input-output-hk/cardano-sl/blob/develop/mnemonic/src/Cardano/Mnemonic.hs#L286-L316

Decision

We do want to port this module onto cardano-wallet, review the style to make it consistent with our coding standards, and remove the bits that aren't relevant to this new code. We do want to make this a module of cardano-wallet (and not a package as it is now), under Cardano.Wallet.Mnemonic.
Tests should also share the same faith and be ported in their rightful place.

Development Plan

PR

Number
Base

#47
master

QA

lgtm :+1:
I wanted to ask about SlottingOrphans.hs but I see it has been removed by #57.

lgtm :+1:
(I have added few more tests and adjusted API spec in #58)


Migrate to Airly API v2.0

There has been a new version of the API released. https://www.facebook.com/airlyeu/posts/814768172031664
We should migrate to it before 30.11.2018. I could work on a PR unless someone jumps in before me 😄

I'm currently redesigning the API client layer, introducing an intermediate aggregation service that we'll run somewhere (I'm evaluating providers, looking for the free or cheapest one). It'll allow to mitigate the rate limits to some degree and to remove the user-provided API keys (better UX). In future it'll allow to integrate more data providers (very often requested).

The new Airly API is supported from v2 onward. The app no longer communicates with the API directly, but through and intermediate caching server. Next version should be released soon.


bump MadNLP version to v0.8

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 69.80%. Comparing base (5f3efa3) to head (9f510ab).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@           Coverage Diff           @@
##           master     #306   +/-   ##
=======================================
  Coverage   69.80%   69.80%
=======================================
  Files          39       39
  Lines        3888     3888
=======================================
  Hits         2714     2714
  Misses       1174     1174

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Botallen not support in my device H96 max. Vll in Idia

Your Environment

Add-on name: [e.g. Jiotv]
Add-on version: [e.g. 2.0.0]
Kodi version: [e.g. Kodi 19]
Operating system version/name: [e.g. Windows 10, LibreElec 9.0, etc...]
Using from country: [eg. Indiabotallen not support
, USA, etc...]

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See an error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
Add any other context about the problem here.
Debug log

The debug log can be found from this link:

Please describe your issue in more detail. Follow the template


error: failed to run custom build command for nethost-sys v0.5.1

I got the below error after update to  nightly-x86_64-pc-windows-msvc - rustc 1.66.0-nightly (6e95b6da8 2022-10-22), any clue ? This was working for a long time.
Caused by:
process didn't exit successfully: H:\TEST\nethost8\target\debug\build\nethost-sys-440c9e86335f8dee\build-script-mod (exit code: 101)
--- stderr
thread 'main' panicked at 'Failed to parse json response from nuget.org.: reqwest::Error { kind: Decode, source: Error("missing field items", line: 1, column: 689) }', C:\RUST\CARGO\registry\src\github.com-1ecc6299db9ec823\nethost-sys-0.5.1\build\download.rs:119:10
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
warning: build failed, waiting for other jobs to finish...
[dependencies]
netcorehost = "0.12.0"
path-absolutize = "^3.0.10"
wchar = "^0.11.0"
json = "*"

Pretty sure this is due to issue https://github.com/OpenByteDev/nethost-sys/issues/2
I got it working with the following.
[dependencies]
netcorehost = { git = "https://github.com/OpenByteDev/netcorehost" }

[patch.crates-io]
nethost-sys = { git = "https://github.com/OpenByteDev/nethost-sys" }

Thanks, it worked, Look like get_function_pointer_with_default_signature disappeared. Any suggestions?

Thanks, it worked, Look like get_function_pointer_with_default_signature disappeared. Any suggestions?

Do you mean this? https://docs.rs/netcorehost/0.12.0/netcorehost/hostfxr/struct.AssemblyDelegateLoader.html#method.get_function_with_default_signature

I published https://github.com/OpenByteDev/nethost-sys/issues/2 in nethost-sys 0.6.1 which should fix this issue.

Thank for update . I am not able to share the loader across threads. It used to work in older version
let fn_loader = context.get_delegate_loader_for_assembly(PdCString::from_os_str(assembly_path).unwrap()).unwrap();

error[E0277]: std::rc::Rc<netcorehost::dlopen2::wrapper::Container<netcorehost::bindings::hostfxr_sys::wrapper::Hostfxr>> cannot be shared between threads safely

That should not have been possible in the first place.


Live preview with Opera browser doesn't work - stuck with "connecting"

As encouraged in last blog post i tried cross-browser live preview with Opera (26.0.1656.60) running it on  Linux Mint with Cinnamon interface (Ubuntu 14.04.1 LTS (x86_64; X-Cinnamon) as seen by browser).
So far (~10 minutes) nothing happened and when i hover mouse pointer over live preview button i see in tooltip: "Live preview - connecting..."
AFAIK Opera is based on the same engine as Chrome.
Brackets used (from brackets):
sprint 1 experimetnal build 1.1.0-15558 (release ea908cae5)
build timestamp: Wed Dec 17 2014 13:00:52 GMT-0800

Could you just try this workaround?

Worked like charm! Thanks a lot.
Also im very sorry, i searched through the issues using keyword "opera" (silly me) so i didn't found that issue.


allow to use infix param

Why This Matters:
Issue #89 highlighted the need for partial match capabilities. infix allows users to get search results with partial word matches, which is a solid boost to our search functionality.
What's New:
Added infix option to the bundle's config.
Updated the search method to pass the infix parameter when present.
Impact:
It enhances search flexibility without impacting existing configurations. It's optional and backward compatible.
Let's merge this if there're no blockers. Any thoughts or tests you want to run, let me know.

@npotier
Hi can you look this PR?

Thank you for this, @james2001. I hope that this PR be merged as soon as possible.


Avalonia 11.0.6 in macos input

Unable to enter text on macos x64 after setting WindowlessRenderingEnabled to true. Switching to the Chinese input method at the same time will cause the program to crash.
CefGlue.Avalonia version:117.5938.2-avalonia11

After upgrading cef.redist.osx64, the Chinese crash problem was solved, but the content could not be entered in the text box

does it happen with WindowlessRenderingEnabled = false?

@joaompneves It has no problem with WindowlessRenderingEnabled = false

I also have issues upgrading it to the latest version
CefGlue.Avalonia version 120

WindowlessRenderingEnabled = false is the recommended value.

@tkefauver  I think it's avalonia's problem and I've submitted issues.I didn't encounter this problem on Windows because I used cefnet


chore(paeckchen): configures conventional-changelog-lint

Coverage remained the same at 100.0% when pulling 87b7fc7997cf6586d6b64b860acd5c93c5fbc5ee on commitmsg-lint into f046661febd05846696659930034c8f788874510 on master.


Update fpgainfo events to latest register specs

Update fpgainfo events to latest register specs.
The failing check does not seem to have anything to do with my code. It complains about missing doxygen, kernel headers not installed, etc.

Coverage decreased (-0.2%) to 61.312% when pulling baffa5944eb86396f70dbddd22548fec70b82698 on ele/n6000-fpgainfo-events-update into dc32d89514da2524cef88d8d4ee2a535ea832884 on master.

In the calls to these functions, I wanted to align the value parameter in the same column as the surrounding calls as it looks much nicer and helps with readability. Coding style check complains about this, it does not allow spaces where I put a dummy NULL parameter. It does not understand esthetics.
Sure, I can change it to the ugly look if you insist.
/Esa

From: Tim Whisonant @.>
Sent: Thursday, November 11, 2021 18:42
To: OPAE/opae-sdk @.>
Cc: Esa Erkki Leskinen @.>; Author @.>
Subject: Re: [OPAE/opae-sdk] Update fpgainfo events to latest register specs (PR #2372)
Caution: This is an external email. Please take care when clicking links or opening attachments.
@tswhison requested changes on this pull request.

In tools/libboard/board_n6000/board_event_log.chttps://github.com/OPAE/opae-sdk/pull/2372#discussion_r747697485:

@@ -218,6 +219,27 @@ static void bel_print_header(const char *label, struct bel_header *header)
printf("  " BEL_LABEL_FMT "%s", 50, label, time_str);
}

+static void reserved_field(void *p, uint32_t value, size_t first, size_t last)
+{

  UNUSED_PARAM(p);  // Need dummy paramater to cheat the coding style check!

Please don't do this. The coding style check is there for a reason. What is the issue?

In tools/libboard/board_n6000/board_event_log.chttps://github.com/OPAE/opae-sdk/pull/2372#discussion_r747697767:

@@ -218,6 +219,27 @@ static void bel_print_header(const char *label, struct bel_header *header)
printf("  " BEL_LABEL_FMT "%s", 50, label, time_str);
}

+static void reserved_field(void *p, uint32_t value, size_t first, size_t last)
+{

  UNUSED_PARAM(p);  // Need dummy paramater to cheat the coding style check!

  uint32_t mask = UINT_MAX >> (32 - (last - first));

  uint32_t field = (value >> first) & mask;

  if (field != 0)

          printf("      *** RESERVED FIELD [%lu:%lu] IS NOT ZERO: 0x%X\n", last - 1, first, field);

+}
+
+static void reserved_bit(void *p, uint32_t value, size_t offset)
+{

  UNUSED_PARAM(p);  // Need dummy paramater to cheat the coding style check!

Please don't do this. Why is the coding style check being subverted?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/OPAE/opae-sdk/pull/2372#pullrequestreview-804061068, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ASQR2UMX4WU4SWR6RVHVOLDULP6AJANCNFSM5HZ3FUXA.
Triage notifications on the go with GitHub Mobile for iOShttps://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Androidhttps://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

I have changed the code slightly so that the first label parameter is actually used.
Don't know why the code checks fail, don't seem to have anything to do with my code but the build environment as far as I can see.


[5.2] Validate presence of APP_KEY key

If the environment file does not have a valid APP_KEY entry, the generated key is not saved, but the command still returns :
Application key [base64:kFi4GlZASPjDXjP7ujztxMWJT+LpspJTHFNhGZT6Juk=] set successfully.
This can lead to confusion because the key was actually not set.
This PR validates the presence of a valid APP_KEY key and displays  an error message if it's missing or invalid.

Why are people deleting the APP_KEY entry from the .env file? Is this actually happening or are we just creating solutions to problems that don't exist?

I see what you mean. In my case the issue was that i had a typo in my .env. Tried to clear the app key and saved the line as:
APP_KEY
without the "=", so it was easy to spot after a quick review.  IMHO the real issue is the wrong message returned: It reports the application key as "set successfully" when that didn't happen.

I'm just going to close this. We have a lot of PRs recently around covering edge cases with this env file and APP_KEY and quotes and no quotes and I'm just tired of messing around in there. It works.


"Unknown error occurred" when running cargo test with RUST_BACKTRACE=1 on the nightly

$ rustup override set stable
info: using existing install for 'stable-x86_64-apple-darwin'
info: override toolchain for '/srcroot/' set to 'stable-x86_64-apple-darwin'

  stable-x86_64-apple-darwin unchanged - rustc 1.21.0 (3b72af97e 2017-10-09)

$ RUST_BACKTRACE=1 cargo test
    Finished dev [unoptimized + debuginfo] target(s) in 0.0 secs
     Running target/debug/deps/tetrus-37eb396d2309593e

running 4 tests
test well::empty_well_should::be_empty ... ok
test game::constructor_should::set_score_to_zero ... ok
test game::start_should::put_next_into_play ... ok
test tetromino_generator::next_should::return_a_tetromino ... FAILED

failures:

---- tetromino_generator::next_should::return_a_tetromino stdout ----
	thread 'tetromino_generator::next_should::return_a_tetromino' panicked at 'assertion failed: `(left != right)`
  left: `Invalid`,
 right: `Invalid`', src/tetromino_generator.rs:47:8
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
stack backtrace:
   0: std::sys::imp::backtrace::tracing::imp::unwind_backtrace
   1: std::panicking::default_hook::{{closure}}
   2: std::panicking::default_hook
   3: std::panicking::rust_panic_with_hook
   4: std::panicking::begin_panic
   5: std::panicking::begin_panic_fmt
   6: tetrus::tetromino_generator::next_should::return_a_tetromino
   7: <F as test::FnBox<T>>::call_box
   8: __rust_maybe_catch_panic

failures:
    tetromino_generator::next_should::return_a_tetromino

test result: FAILED. 3 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out

error: test failed, to rerun pass '--lib'

$ rustup override set nightly
info: using existing install for 'nightly-x86_64-apple-darwin'
info: override toolchain for '/srcroot/' set to 'nightly-x86_64-apple-darwin'

  nightly-x86_64-apple-darwin unchanged - rustc 1.23.0-nightly (bd0e45a32 2017-11-06)

------------------------------------------------------------
$ RUST_BACKTRACE=1 cargo test
    Finished dev [unoptimized + debuginfo] target(s) in 0.0 secs
     Running target/debug/deps/tetrus-0a186c44f7f3bff7

running 4 tests
test well::empty_well_should::be_empty ... ok
test game::constructor_should::set_score_to_zero ... ok
test game::start_should::put_next_into_play ... ok
error: An unknown error occurred

Let me know if you'd need more details.
Thanks a lot !

I thinkt this is probably https://github.com/rust-lang/rust/issues/45731 which was fixed very recently and I don't think has made it into the nightlies yet, but thanks for the report!


Getting error "No package matching 'php7.1' is available"

Issue Type

Bug Report / Support Request

Your Environment
Vagrant 2.2.0
VirtualBox 5.2.28r130011
ansible 2.7.10
config file = None
configured module search path = [u'/Users/himanshusharma/.ansible/plugins/modules', u'/usr/share/ansible/plugins/modules']
ansible python module location = /Library/Python/2.7/site-packages/ansible
executable location = /usr/local/bin/ansible
python version = 2.7.10 (default, Feb 22 2019, 21:17:52) [GCC 4.2.1 Compatible Apple LLVM 10.0.1 (clang-1<IP_ADDRESS>)]

Your OS

macOS Mojave (10.14.4)

Not sure why I am getting error "No package matching 'php7.1' is available", while running command "vagrant up --provision", while it was working fine earlier.
I  removed and re download vagrant box, and start getting error.
Summary
TASK [geerlingguy.php : Ensure PHP packages are installed.] ********************
[DEPRECATION WARNING]: Invoking "apt" only once while using a loop via
squash_actions is deprecated. Instead of using a loop to supply multiple items
and specifying `name: "{{ item }}"`, please use `name: '{{ php_packages }}'`
and remove the loop. This feature will be removed in version 2.11. Deprecation
warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
failed: [unicefplatform] (item=[u'php7.1', u'php7.1-apcu', u'php7.1-cli', u'php7.1-common', u'php7.1-curl', u'php7.1-dev', u'php7.1-fpm', u'php7.1-gd', u'php7.1-imap', u'php7.1-json', u'php7.1-mbstring', u'php7.1-mcrypt', u'php7.1-opcache', u'php7.1-sqlite3', u'php7.1-xml', u'php7.1-yaml', u'php7.1-bz2', u'php7.1-imagick', u'php7.1-yaml', u'imagemagick']) => {"changed": false, "item": ["php7.1", "php7.1-apcu", "php7.1-cli", "php7.1-common", "php7.1-curl", "php7.1-dev", "php7.1-fpm", "php7.1-gd", "php7.1-imap", "php7.1-json", "php7.1-mbstring", "php7.1-mcrypt", "php7.1-opcache", "php7.1-sqlite3", "php7.1-xml", "php7.1-yaml", "php7.1-bz2", "php7.1-imagick", "php7.1-yaml", "imagemagick"], "msg": "No package matching 'php7.1' is available"}
	to retry, use: --limit @/Users/himanshusharma/Sites/unicef/unicef-drupal-base/vendor/geerlingguy/drupal-vm/provisioning/playbook.retry

PLAY RECAP *********************************************************************
unicefplatform             : ok=73   changed=0    unreachable=0    failed=1

Ansible failed to complete successfully. Any error output should be
visible above. Please fix these errors and try again.

What version of base box are you using? Also, that deprecation warning was fixed a few versions of Drupal VM ago, maybe it's just an old Drupal VM instance? Drupal VM is now at 5.0.0, in case you are able to upgrade; the latest 4.x version also fixed that warning.

Started observing this error this weekend in our CI builds. Looks like an issue with the PHP Ansible role, so opened up https://github.com/geerlingguy/ansible-role-php/issues/264.

@Drew-Kimberly and @himan5050 - Can you please give more steps to reproduce? I am not seeing this issue on any of my builds (with 7.2 or 7.1).


Added log option to histogram operation

This adds a log option to the histogram operation, which automatically generates logarithmic sampling for the histogram bins. Also includes a small fix to fix bokeh histograms with inverted axes.

Other than a small comment about the docstring, this PR looks fine and I am happy to merge.

Other than one unrelated test failure, the tests seem to be ok. Merging.


Add styling to pad outlineEntry toolbar

before:

after:

How does it look when there is no scrollbar? In this case, it would be good to keeps the previous align.


Error: Moshi.Builder.addAdapter() declaration needs ExperimentalStdlibApi opt-in

Moshi: 1.14.0
MoshiX: 0.21.0
Kotlin: 1.8.10
KSP: 1.8.10-1.0.9
Also seen on MoshiX 0.20.0. The rollback of the version to 0.19.0 helped.
Code:
@JsonClass(generateAdapter = true, generator = "sealed:type")
sealed interface PrefFavoritesSort {
    val direction: PrefSortDirection

    @TypeLabel("unknown")
    object Unknown : PrefFavoritesSort {
        override val direction: PrefSortDirection
            get() = PrefSortDirection.Unknown
    }

    @TypeLabel("date_added")
    @JsonClass(generateAdapter = true)
    data class DateAdded(
        override val direction: PrefSortDirection
    ) : PrefFavoritesSort
}

Generated code:
@Suppress("DEPRECATION", "unused", "ClassName", "REDUNDANT_PROJECTION", "RedundantExplicitType",
    "LocalVariableName", "RedundantVisibilityModifier")
public class PrefFavoritesSortJsonAdapter(
  moshi: Moshi,
) : JsonAdapter<PrefFavoritesSort>() {
  private val runtimeAdapter: JsonAdapter<PrefFavoritesSort>

  init {
    val moshi_ = moshi.newBuilder()
            .addAdapter<PrefFavoritesSort.Unknown>(ObjectJsonAdapter(PrefFavoritesSort.Unknown))
        .build()
...

Build log:
PrefFavoritesSortJsonAdapter.kt:26:14 This declaration needs opt-in. Its usage must be marked with<EMAIL_ADDRESS>or '@OptIn(kotlin.ExperimentalStdlibApi::class)'

We're getting the above too. The OptIn annotation seems to be generated in the wrong place?


added password validations in front-end

Related Issue
added password validations in front-end
Closes: #343
Describe the changes you've made
https://user-images.githubusercontent.com/55352601/120113539-91308d00-c198-11eb-8075-6462aecea43a.mp4
Type of change
What sort of change have you made:

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Code style update (formatting, local variables)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Mention any unusual behaviour of your code (Write NA if not)
Any unusual behaviour of your code
Additional Info (optional)
Any additional information you want to give
Checklist:

[ ] My code follows the guidelines of this project.
[ ] I have performed a self-review of my own code.
[ ] I have commented my code, particularly whereever it was hard to understand.
[ ] My changes generate no new warnings.
[ ] Any dependent changes have been merged and published in downstream modules.

@ankitapuri please review this PR


Application rejected on Apple Store caused by Google Maps

Hey everybody!
I previously have submitted my app to the Apple Store (a month ago) and it was approved, but I want to submit a new release and the app is rejected because of:
Your app's location feature is still not integrated with the built-in mapping functionality, which limits users to a third-party maps app.

My app is an ionic 2 one, with the following plugins for geolocation:
com.googlemaps.ios 2.1.1 "Google Maps SDK for iOS"
cordova-plugin-geolocation 2.4.2 "Geolocation"
cordova-plugin-googlemaps 1.4.0 "phonegap-googlemaps-plugin"

The process of the app is pretty simple, one view for signin/signup, and when the user is registered, the application launch a google maps with a bottom navigation bar. I see some resources about google maps issues, but they said it is fix on the version 1.13..., but I'm using the 2.1.1 version, so I need help!
Thank you (for the plugin ;)) and for your support
Adrien

As far as I know, Google Maps SDK and this plugin do not use limited features of iOS.
Any comments more than "Your app's location feature is still not integrated with the built-in mapping functionality, which limits users to a third-party maps app."
It's too less information.

Thank you for your reply,
Here is the full Apple comment, which does not give more information:
4. Design: Preamble
Design Preamble

Your app's location feature is still not integrated with the built-in mapping functionality, which limits users to a third-party maps app.

Please see the attached screenshot for details. (<- the attachment is just a screenshot of my app)

Next Steps

To resolve this issue, please revise your app to give users the option to launch the native Apple Maps app.

Thanks

Please see the attached screenshot for details. (<- the attachment is just a screenshot of my app)

Please attach also this one.

I have similar page with google maps and I'm planning to push it on app store soon, I'd like to hear more of this issue.
Thanks for any update @anouvel

http://stackoverflow.com/questions/36167212/my-application-was-rejected-due-to-google-maps

they say: "to give users the option to launch the native Apple Maps..."

After making phone call, reviewer said that using only GMSMapView is the reason for rejection and MKMapView should be given as an option to show coordinates. I used only GMSMapView in my app and they rejected it just for that! There is no written rule for this rejection.

I discussed with my expert friends. They suggested you should try to submit your application again, because the result of Apple validation is really depends on the person who inspected your app.

Hi!
In fact that's what I did yesterday morning, "just to try", and they reply me a few hours ago, they rejected it at the beginning, I wrote them a message to explain what is my application, and why I can't / want to use the native Apple maps, and they just accept it, so it's okay for my release.
Thank you a lot @wf9a5m75, and @msio777 good luck!

Sounds great! 👍

thanks man @anouvel I appreciate your help 👍


Parameters for reproducing results from paper

Can you provide the parameters for reproducing the results from the paper on FB15k and FB15K-237?  I ran the command from the README:
 CUDA_VISIBLE_DEVICES=0 python main.py --dataset FB15k-237 --num_iterations 500 --batch_size 128
                                       --lr 0.0005 --dr 1.0 --edim 200 --rdim 200 --input_dropout 0.3
                                       --hidden_dropout1 0.4 --hidden_dropout2 0.5 --label_smoothing 0.1

which gave final performance of
Number of data points: 35070
Hits @10: 0.4009124607927003
Hits @3: 0.2555460507556316
Hits @1: 0.1760193897918449
Mean rank:<PHONE_NUMBER>2748786
Mean reciprocal rank: 0.24741750020439274
Test:
Number of data points: 40932
Hits @10: 0.3974396560148539
Hits @3: 0.2546662757744552
Hits @1: 0.17094205022964917
Mean rank:<PHONE_NUMBER>6289457
Mean reciprocal rank: 0.24344486414937788

Any ideas?
UPDATE: I noticed in the paper that you mention the best learning rate for FB15k-237 is 0.005 instead of 0.0005 and best the learning rate decay is 0.995 instead of 1.0 -- might that be the issue?

The command you ran is the one that should reproduce the results from the paper. Actually, in the paper we say (0.0005, 1.0) are the best learning and decay rate for FB15k-237 and (0.005, 0.995) are the best ones for WN18. Either way, from my experience, whichever learning rate and decay rate you choose, it shouldn't influence the results that much (definitely not by almost 15% on hits@10).
I just reran the command from README and got these numbers:
Test:
Number of data points: 40932
Hits @10: 0.5443513143750611
Hits @3: 0.39400938141307534
Hits @1: 0.26598867389817256
Mean rank:<PHONE_NUMBER>5962083
Mean reciprocal rank: 0.3578093749942233

I'm not really sure why your numbers are so different, are you maybe using a different version of PyTorch?

I was using torch==0.1.0 -- I'll try again w/ torch==0.4.0 and let you know.

I figured out what was going on -- I had to make some small changes to get torch==1.0.0 to stop complaining, and I made a small mistake.  Thanks for your help!

Do you happen to have the exact parameters you used for the other experiments?

I've just updated the README with hyperparameter combinations for all the models.

Thanks!
On Fri, Feb 15, 2019 at 11:15 AM Ivana Balazevic<EMAIL_ADDRESS>wrote:

I've just updated the README with hyperparameter combinations for all the
models.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/ibalazevic/TuckER/issues/2#issuecomment-464107508,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFzgfftRWo5YDrk9QS2uoTv_mBR9RFxgks5vNt01gaJpZM4a82FC
.

I used torch==1.0.0 and cannot reproduce the results from the paper.  What changes do you make from torch==0.4.0 to torch==1.0.0?  Thanks for your help!


helmfile deps - Error: could not find : no matching version

Operating system
Ubuntu 20.04 LTS
Helmfile Version
0.156.0
Helm Version
v3.12.2
Bug description
Can't generate helmfile.lock from helmfile deps
Example helmfile.yaml
repositories:
  # minio
  - name: minio
    url: git+https://github.com/minio/operator@helm?ref=master
  # cert manager
  - name: jetstack
    url: https://charts.jetstack.io
  # kafka
  - name: redpanda
    url: https://charts.redpanda.com
  # cloudnative postgres
  - name: cnpg
    url: git+https://github.com/cloudnative-pg/charts@charts/cloudnative-pg?ref=main
  # observability
  - name: grafana
    url: https://grafana.github.io/helm-charts

releases:
  # minio
  - name: minio-operator
    namespace: minio-operator
    createNamespace: true
    chart: minio/operator
  # TODO:
  # - figure out why the tenant doesn't work???
  # - name: minio-tenant
  #   namespace: minio-tenant
  #   createNamespace: true
  #   chart: minio/tenant
  # cert manager
  - name: cert-manager
    namespace: cert-manager
    createNamespace: true
    chart: jetstack/cert-manager
    set:
      - name: installCRDs
        value: true
  # redpanda
  - name: redpanda-operator
    namespace: redpanda
    createNamespace: true
    chart: redpanda/operator
  # cloudnative postgres
  - name: cnpg
    namespace: cnpg-system
    createNamespace: true
    chart: cnpg/cloudnative-pg
  # observability
  - name: grafana
    namespace: observability
    createNamespace: true
    chart: grafana/grafana

Error message you've seen (if any)
Adding repo minio git+https://github.com/minio/operator@helm?ref=master
"minio" has been added to your repositories

Adding repo jetstack https://charts.jetstack.io
"jetstack" has been added to your repositories

Adding repo redpanda https://charts.redpanda.com
"redpanda" has been added to your repositories

Adding repo cnpg git+https://github.com/cloudnative-pg/charts@charts/cloudnative-pg?ref=main
"cnpg" has been added to your repositories

Adding repo grafana https://grafana.github.io/helm-charts
"grafana" has been added to your repositories

Updating dependency /tmp/nix-shell.iMzTMN/2149760593
Hang tight while we grab the latest from your chart repositories...
...Successfully got an update from the "redpanda" chart repository
...Successfully got an update from the "jetstack" chart repository
...Successfully got an update from the "dagster" chart repository
...Successfully got an update from the "grafana" chart repository
...Successfully got an update from the "lsstsqre" chart repository
...Successfully got an update from the "strimzi" chart repository
...Successfully got an update from the "apache-airflow" chart repository
...Successfully got an update from the "argo" chart repository
...Successfully got an update from the "lakefs" chart repository
...Successfully got an update from the "datahub" chart repository
...Successfully got an update from the "stackable-stable" chart repository
...Successfully got an update from the "flyteorg" chart repository
...Successfully got an update from the "cnpg" chart repository
...Successfully got an update from the "bitnami" chart repository
...Successfully got an update from the "minio" chart repository
Update Complete. ⎈Happy Helming!⎈
Saving 5 charts
Downloading grafana from repo https://grafana.github.io/helm-charts
Save error occurred:  could not find : no matching version

in ./helmfile.yaml: unable to update deps: unable to update 4 deps: command "/home/alex/.nix-profile/bin/helm" exited with non-zero status:

PATH:
  /home/alex/.nix-profile/bin/helm

ARGS:
  0: helm (4 bytes)
  1: dependency (10 bytes)
  2: update (6 bytes)
  3: /tmp/nix-shell.iMzTMN/2149760593 (32 bytes)

ERROR:
  exit status 1

EXIT STATUS
  1

STDERR:
  Error: could not find : no matching version

COMBINED OUTPUT:
  Hang tight while we grab the latest from your chart repositories...
  ...Successfully got an update from the "redpanda" chart repository
  ...Successfully got an update from the "jetstack" chart repository
  ...Successfully got an update from the "dagster" chart repository
  ...Successfully got an update from the "grafana" chart repository
  ...Successfully got an update from the "lsstsqre" chart repository
  ...Successfully got an update from the "strimzi" chart repository
  ...Successfully got an update from the "apache-airflow" chart repository
  ...Successfully got an update from the "argo" chart repository
  ...Successfully got an update from the "lakefs" chart repository
  ...Successfully got an update from the "datahub" chart repository
  ...Successfully got an update from the "stackable-stable" chart repository
  ...Successfully got an update from the "flyteorg" chart repository
  ...Successfully got an update from the "cnpg" chart repository
  ...Successfully got an update from the "bitnami" chart repository
  ...Successfully got an update from the "minio" chart repository
  Update Complete. ⎈Happy Helming!⎈
  Saving 5 charts
  Downloading grafana from repo https://grafana.github.io/helm-charts
  Save error occurred:  could not find : no matching version
  Error: could not find : no matching version

Steps to reproduce
helmfile deps
Working Helmfile Version

Relevant discussion
No response

assign to me.

@rupurt could you give a minimal demo to reproduce this issue? thanks so much.

releases:
  # minio
  - name: minio-operator
    namespace: minio-operator
    createNamespace: true
    chart: minio/operator
  # redpanda
  - name: redpanda-operator
    namespace: redpanda
    createNamespace: true
    chart: redpanda/operator

see the above. they have the same chart name. operator
ChartName identifies the dependant chart. In Helmfile, ChartName for chart: stable/envoy would be just envoy.
It can't be collided with other charts referenced in the same helmfile spec.
That is, collocating chart: incubator/foo and chart: stable/foo isn't allowed. Name them differently for a work-around.

@rupurt

name: helmfile
version: 1.0.0
apiVersion: v2
dependencies:
- name: operator
  repository: git+https://github.com/minio/operator@helm/operator?ref=master
  version: '*'
- name: operator
  repository: https://charts.redpanda.com
  version: '*'

Chart.yaml
it will fail when running helm dependency update . --debug. so I think we should post an issue in helm.

@rupurt

see: https://github.com/helm/helm/pull/12593


Set causer globally (inside Jobs)

Is there any way to set the causer, globally, to be something else than the logged user? I know is possible to manually log an activity and specify the causer, but I have a Data Importer model that should be related to the events while running inside a Job.
This is what happens when the user creates a Data Importer:
$dataImporter = DataImporter::create(...); // Logs created for DataImporter caused by the user.
\App\Jobs\StartDataImporter::dispatch($dataImporter); // Will queue for processing.

The StartDataImporter will perform all tasks and generate all related models. The causer on those created/updated events should be the DataImporter.

My question is, is there any way to accomplish that? So all models created/updated by the DataImporter will have it as the causer.

Hey,
atm there's no easy out of the box way. This also duplicates #560 in some parts.
The current dirty workaround could be to use the tapActivity() and associate the causer by reading any global value like a static variable/property, class bound to DIC.
So for example adding a static setActivityCauser() method (via trait) to all models which need it. This sets s static property and during tapActivity() you read this value and if it's a model instance you associate it. And at start of the queue job you call this method for all models with the DataImporter model instance.
For sure we will count your vote on this feature request and think about a better solution to solve it. Because in all three issues there are also other things request which heavily relate to each other it could need some time to find a good way which could solve them.

This is actually completely possible as I'm doing it right now. If the Job is running in a queue, then just run the job and pass through the user/id that should be then have an Auth::login call, just be sure to run the associated Auth::logout() call. This will ensure that the user is associated to the generated activity logs and the logout is to ensure there isn't any "session" leakage to other jobs in the same worker. Either way it's totally possible right now.

how does one change the causer inside tapActivity() ?

seems like $activity->causer()->associate($user); does the trick

There is a way to not log the activity if the causer is null ? I just want to log the activity for logged users.

@CharlieRa you could use an observer which returns false in the saving event if the causer is null.
// If the "saving" event returns false we'll bail out of the save and return
// false, indicating that the save failed. This provides a chance for any
// listeners to cancel save operations if validations fail or whatever.

@CharlieRa you could use an observer which returns false in the saving event if the causer is null.
// If the "saving" event returns false we'll bail out of the save and return
// false, indicating that the save failed. This provides a chance for any
// listeners to cancel save operations if validations fail or whatever.

Works perfectly, thanks!

I will close this issue even if v4 isn't released yet. But the task itself is done and I want to check which tasks are really open. Please keep an eye on #787


Enforce Pigeon minimum version in Paloma

Related Github tickets

https://github.com/VolumeFi/paloma/issues/462

Background
This has been a long time coming.  We often release code that is incompatible with previous versions of Pigeon.  Even when done in a backwards-compatible way, backwards compatibility isn't meant to extend backwards forever.  We need a way of specifying the minimum version of Pigeon that the current version of Paloma works with.  It's currently expected that any newer versions of Pigeon will also work with the current version of Paloma
The minimum required version of Pigeon is specified in the app.go file and should be mentioned in any proposed paloma update that goes through governance.  Users can upgrade to the latest version of Pigeon ahead of the Paloma upgrade.
Part of this PR includes cleaning up extra places where we were calling the keepalive functionality.  Keepalive should only happen in its own workflow, not as a tag-along to other workflows.
I also removed the ability to send a keepalive message with the CLI.  I can come up with no reason why we would want to have this ability.
More info can be seen in the Epic: https://www.notion.so/volumefi/Epic-07-14-23-Governance-for-pigeon-version-check-8f8fd1dbd4d24a40a3007294f172c738
Testing completed

[x] test coverage exists or has been added/updated
[x] tested in a private testnet

Breaking changes

[x] I have checked my code for breaking changes
[x] If there are breaking changes, there is a supporting migration.

I'm marking this as ready for review.  After discussion in Discord, it sounds like we're aligned and agree on this strategy


What is the best practice for rolling upgrade of deployments with ConfigMap changes?

I had been using helm upgrade with the --recreate-pods option. Problem is this instantly terminates the original pods. It does not wait for new pods to become ready (even with readinessProbes configured), so is not really a rolling upgrade!
The reason I started using this --recreate-pods flag was due to helm not processing upgrades to ConfigMaps without it set.
I'd be interested to know what the correct approach is to be able to handle rolling upgrades when changes to ConfigMaps need to be included in the upgrade.
Output of helm version:
helm version                                                      (master)
Client: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"}
Server: &version.Version{SemVer:"v2.11.0", GitCommit:"2e55dbe1fdb5fdb96b75ff144a339489417b146b", GitTreeState:"clean"}
Output of kubectl version:
Client Version: version.Info{Major:"1", Minor:"11", GitVersion:"v1.11.3", GitCommit:"a4529464e4629c21224b3d52edfe0ea91b072862", GitTreeState:"clean", BuildDate:"2018-09-09T18:02:47Z", GoVersion:"go1.10.3", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"10", GitVersion:"v1.10.3", GitCommit:"2bba0127d85d5a46ab4b778548be28623b32d0b0", GitTreeState:"clean", BuildDate:"2018-05-21T09:05:37Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/amd64"}
Cloud Provider/Platform (AKS, GKE, Minikube etc.):
AWS

This has been documented at https://docs.helm.sh/developing_charts/#automatically-roll-deployments-when-configmaps-or-secrets-change :)

The linked page is no longer available

@baracoder Try this: https://helm.sh/docs/howto/charts_tips_and_tricks/#automatically-roll-deployments


bazel is not supported on darwin

Issue description
Bazel is marked "broken" for darwin. Forcing it yields a failed assertion:
nix-env -i bazel --show-trace
installing ‘bazel-0.3.2’
error: while evaluating the attribute ‘nativeBuildInputs’ of the derivation ‘bazel-0.3.2’ at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/development/tools/build-managers/bazel/default.nix:25:5:
while evaluating the attribute ‘buildCommand’ of the derivation ‘bazel-bootstrap-env’ at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/build-support/trivial-builders.nix:7:14:
while evaluating the attribute ‘text’ of the derivation ‘bazel-bootstrap-env-init’ at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/build-support/trivial-builders.nix:7:14:
while evaluating the attribute ‘buildCommand’ of the derivation ‘bazel-bootstrap-env-fhs’ at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/build-support/build-fhs-userenv/env.nix:183:3:
while evaluating the attribute ‘pkgs’ of the derivation ‘bazel-bootstrap-env-usr-target’ at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/build-support/trivial-builders.nix:7:14:
while evaluating ‘callPackageWith’ at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/lib/customisation.nix:95:35, called from /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/top-level/all-packages.nix:7100:11:
while evaluating ‘makeOverridable’ at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/lib/customisation.nix:54:24, called from /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/lib/customisation.nix:99:8:
while evaluating anonymous function at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/development/libraries/glibc/default.nix:1:1, called from /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/lib/customisation.nix:56:12:
assertion failed at /nix/store/wi4y04kphl122mdq8zp76c1bw5azr7h2-nixpkgs-17.03pre95946.1fec301/nixpkgs/pkgs/development/libraries/glibc/default.nix:8:1

Steps to reproduce
nix-env -i bazel

Technical details

System: (NixOS: nixos-version, Ubuntu/Fedora: lsb_release -a, ...)

OSX Sierra

Nix version: (run nix-env --version)

nix-env (Nix) 1.11.4

Nixpkgs version: (run nix-instantiate --eval '<nixpkgs>' -A lib.nixpkgsVersion)

17.03pre95946.1fec301

Note:
bazel depends on getconf, which is apparently provided only by buildFHSUserEnv; which in turns is not available on darwin.

That's not very friendly to depend on buildFHSUserEnv ☹  I'm guessing someone will need to think through how to make that work without it, probably with some judicious use of patchelf (on Linux) and install_name_tool (on Darwin) to rewrite the bootstrap binaries to point to sensible places in the store.

This is the pull request, which introduced bazel:
https://github.com/NixOS/nixpkgs/pull/19380

Yeah, I wrote this implementation. I tried a number of other strategies in addition to buildFHSUserEnv, which really isn't meant to be used at build-time like this, but it's very finicky. The build process for this package results in the various compiler binaries having hardcoded paths that are used, not for themselves, but for programs they build. So the dependencies in that category need to be in the same locations at build-time and run-time.
I don't have access to a Darwin machine right now, but would be happy to advise.

I spent almost a day on trying to get bazel to work in a more standard way without success. I think working with upstream to make it less "weird" would be the most productive long term plan. There's also a newer version so maybe it's worth trying an update & testing.

today the build changed from "dependency failed" to "failed".  It seems there hasn't been a successful hydra build of bazel (x86_64-linux) since september: https://hydra.nixos.org/build/45076997
I'm listed as maintainer but I don't really understand the current implementation.

I think it's useful to look into the possible getconf dependency, because that definitely isn't declared explicitly. The log on that hydra link says "file not found" but doesn't say what file, so it's almost certainly something like that.
When I get a chance in the next few days, I'll see whether I can reproduce this locally - I admit I'm not actually sure how to make my local test build use a container.
@philandstuff, I don't really have the bandwidth to be the maintainer for this package, so what I'd like to do is share enough knowledge that you're able to continue being the maintainer? Or somebody else, I'm not picky.

looking at the error it looks like user-chroot fails to mount one of the following directories:
mounts = { '/' => 'host',
           '/proc' => nil,
           '/sys' => nil,
           '/nix' => nil,
           '/tmp' => nil,
           '/var' => nil,
           '/run' => nil,
           '/dev' => nil,
           '/home' => nil,
         }

Okay, on further investigation, it is specifically trying to do a recursive bind-mount of /sys into the chroot directory, and that is failing. The reason that it fails with /sys but succeeds with / and /proc is that it is already running in some sort of chroot, and that environment doesn't have all the top-level directories that the outer one does. If it got that far, it would also need /var, /run, and /home.
I don't think Bazel actually needs those directories, and I'm currently experimenting with a modified copy of user-chroot.rb which doesn't try to mount them. So far, the bazel executable produced this way can produce working Java programs, but fails to find the "as" command when asked to compile C++. I'm reasonably sure this is an unrelated problem, but it highlights the need for more automated tests...
The main users of buildFHSUserEnv are things like Steam, which definitely need those mounts set up, so I don't think changing the behavior is a good idea. Perhaps the best fix is to fork it, and create buildFHSBuildEnv, which for now would only differ in the set of mounts it creates? That seems like a lot of work...

I currently do not see any user of the extraBindMounts arguments. That's why I would suggest the following change:
the nix function buildFHSEnv could take an argument called bindMounts. The default value of this list would be same as the current hard coded list in chroot-user.rb. Inside the ruby script CHROOTENV_BINDS=` would then get the complete list of mounts instead of the current CHROOTENV_EXTRA_BINDS=``.

Does Hydra even allow the creation of namespaces of this sort from inside a build? With build-use-sandbox = true, it seems unlikely that we'd be able to use them.

@copumpkin it should be possible without privileges to create nested username spaces. LXC does this.

I know very little about bazel, but I think the chroot approach is not the right approach.
It seems that bazel does have support for specifying where to look for the compiler and other tools. This can normally be configured by adding an appropriate entry in CROSSTOOL. Here is some information on using your own custom toolchain:
https://github.com/bazelbuild/bazel/wiki/Building-with-a-custom-toolchain
So, I am thinking that instead of trying to make darwn/nix look like FHS we instead want to tell bazel what our custom toolchain looks like.
Now, the bazel bootstrapping process does not use the CROSSTOOL that you can find in the source. Instead it uses the one created on the fly in cc_configure.bzl:
https://github.com/stepcut/bazel-0.4.3/blob/master/tools/cpp/cc_configure.bzl#L192
As an experiment, I hacked my local copy of bazel-0.4.3-dist and added in the local paths that are currently correct for my system:
https://github.com/stepcut/bazel-0.4.3/commit/50b06fb44bbb7f2468f9da5b77ced280b82fb897
And it built! Though when I try to run I get an error. Here is the full set of steps.
First I downloaded and unpacked bazel-0.4.3-dist.zip.
Then I entered a nix-shell:
 $ nix-shell -p clang openjdk8 darwin.apple_sdk.frameworks.CoreServices

Then I ran env | grep NIX_ to get a list of the extra compiler/linker flags I might need. The values for NIX_CFLAGS_COMPILE, NIX_CXXSTDLIB_COMPILE, NIX_LDFLAGS, etc.
Then I hacked up cc_configure.bzl so that the builds using those extra flags.
Then I just run ./compile.sh and it produces an executable!
Unfortunately, when I run the executable I get the following error:
$ ./output/bazel
dyld: Symbol not found: _kCFURLIsExcludedFromBackupKey
  Referenced from: /Users/stepcut/projects/bazel-0.4.3/./output/bazel
  Expected in: flat namespace
 in /Users/stepcut/projects/bazel-0.4.3/./output/bazel
Trace/BPT trap: 5

I assume this is due to some bit of arcane OS X linking that I don't understand. But is hopefully easy to fix.
There are at least two remaining challenges.

how to I fix that runtime dynamic linking error

how do we patch cc_configure.bzl at build time to add the extra flags. That is trickier than just adding a static patch in the .nix file since the paths have nix hashes in them.

Another challenge is that you can't just plop the NIX_CFLAGS_COMPILE value directly into the cc_configure.bzl file. You need to actually break all the separate arguments up into separate arguments.
Thoughts? All I really want is to be able to install tensorflow on darwin (and linux-armv7).

That's definitely a possible approach. I did try it for most of a day before settling on the chroot strategy, and wasn't able to make it work.
After the dynamic linker is fixed, you'll discover that there are other things it hardcodes, many of them not in ways that patchelf can find. To catch them all you need to use it to compile and run libraries and executables in C++ and Java. Before I did my rewrite of the package, it was successfully building a bazel which could not be used to build anything else.
The general thing to keep in mind is that any time you point Bazel or its bootstrap process to something, make sure it's in the location that it will be forever, even later on at runtime. So, don't put things at temporary locations just to get Bazel built.
I'm afraid I don't have a Nix-Darwin install, so I can't help with that error specifically.


Help with porting a spider used with scrapy-splash

Hello there!
I'm new with Scrapy and Python.
This is the spider I used with scrapy-splash:
import scrapy
from scrapy.spiders import CrawlSpider, Rule
from scrapy.linkextractors import LinkExtractor
from scrapy_splash import SplashRequest, SplashJsonResponse, SplashTextResponse
from scrapy.http import HtmlResponse

class SplashItem(scrapy.Item):
    h1 = scrapy.Field()
    h2 = scrapy.Field()
    h3 = scrapy.Field()

class SplashSpider(CrawlSpider):
    name = 'splash'
    allowed_domains = ['www.domain.org']
    start_urls = ['https://www.domain.org/category/post']
    rules = (
        Rule(LinkExtractor(allow='^https://www.domain.org/category/'), callback='parse_item', process_request='use_splash', process_links='filter_links', follow=True),
    )

    def filter_links(self, links):
        for link in links:
            if '?' in link.url:
                continue
            else:
                yield link

    def start_requests(self):
        for url in self.start_urls:
            yield SplashRequest(url, args={'wait':15, 'html':1, 'script':1}, meta={'real_url': url})

    def use_splash(self, request):
        request.meta['splash'] = {
                'endpoint':'render.html',
                'args':{'wait':15, 'html':1, 'script':1}
                }
        return request

    def _requests_to_follow(self, response):
        if not isinstance(
                response,
                (HtmlResponse, SplashJsonResponse, SplashTextResponse)):
            return
        seen = set()
        for n, rule in enumerate(self._rules):
            links = [lnk for lnk in rule.link_extractor.extract_links(response)
                     if lnk not in seen]
            if links and rule.process_links:
                links = rule.process_links(links)
            for link in links:
                seen.add(link)
                r = self._build_request(n, link)
                yield rule.process_request(r)

    def parse_item(self, response):
        item = SplashItem()
        item['h1'] = response.xpath('normalize-space(/html/body/h1/text())').get()
        item['h2'] = response.xpath('normalize-space(/html/body/h2/text())').get()
        item['h3'] = response.xpath('normalize-space(/html/body/h3/text())').get()
        yield item

I don't know how to adapt the process_request and _requests_to_follow functions.
Do you recommend to use await asyncio.sleep(1) in parse function to prevent being rate limited?
Thanks a lot!!!

I don't really have experience working with scrapy-splash, but looking at the documentation for render.html I think the following should work:
from scrapy_pyppeteer.page import PageCoroutine

class SplashSpider(CrawlSpider):

    def use_splash(self, request, response):
        request.meta.update({
            "pyppeteer": True,
            "pyppeteer_page_coroutines": [
                PageCoroutine("waitFor", 15000),  # milliseconds
            ],
        })
        return request

The Splash docs for the wait argument say it is the "Time (in seconds) to wait for updates after page is loaded", I think the Page.waitFor coroutine should work for that. I see html and script do not apply to render.html, so I ignored them.
Regarding _requests_to_follow, I see the only change is to support alternative response classes, I think that should keep working fine.
Thanks for using this project!

Thank you for your reply!
It works great but it's not possible to use start_requests when using process_request, so the first request is not processed through pyppeteer when using custom process_request callback. It looks like a custom _requests_to_follow method is needed to make them work together.
Amazing project!

For start_requests you could do:
def start_requests(self):
    for url in self.start_urls:
        yield scrapy.Request(
            url=url,
            meta={
                "pyppeteer": True,
                "pyppeteer_page_coroutines": [
                    PageCoroutine("waitFor", 15000),
                ],
            },
        )

I used:
    def start_requests(self):
        for url in self.start_urls:
            yield Request(url=url, meta={"pyppeteer": True}, callback=self.parse_item)

    def pyppeteer_request(self, request, response):
        request.meta.update({"pyppeteer": True})
        return request

When I use start_requests, it only crawls the links set in start_urls.

Hello there!
I'm new with Scrapy and Python.
This is the spider I used with scrapy-splash:
import scrapy
from scrapy.spiders import CrawlSpider, Rule
from scrapy.linkextractors import LinkExtractor
from scrapy_splash import SplashRequest, SplashJsonResponse, SplashTextResponse
from scrapy.http import HtmlResponse

class SplashItem(scrapy.Item):
    h1 = scrapy.Field()
    h2 = scrapy.Field()
    h3 = scrapy.Field()

class SplashSpider(CrawlSpider):
    name = 'splash'
    allowed_domains = ['www.domain.org']
    start_urls = ['https://www.domain.org/category/post']
    rules = (
        Rule(LinkExtractor(allow='^https://www.domain.org/category/'), callback='parse_item', process_request='use_splash', process_links='filter_links', follow=True),
    )

    def filter_links(self, links):
        for link in links:
            if '?' in link.url:
                continue
            else:
                yield link

    def start_requests(self):
        for url in self.start_urls:
            yield SplashRequest(url, args={'wait':15, 'html':1, 'script':1}, meta={'real_url': url})

    def use_splash(self, request):
        request.meta['splash'] = {
                'endpoint':'render.html',
                'args':{'wait':15, 'html':1, 'script':1}
                }
        return request

    def _requests_to_follow(self, response):
        if not isinstance(
                response,
                (HtmlResponse, SplashJsonResponse, SplashTextResponse)):
            return
        seen = set()
        for n, rule in enumerate(self._rules):
            links = [lnk for lnk in rule.link_extractor.extract_links(response)
                     if lnk not in seen]
            if links and rule.process_links:
                links = rule.process_links(links)
            for link in links:
                seen.add(link)
                r = self._build_request(n, link)
                yield rule.process_request(r)

    def parse_item(self, response):
        item = SplashItem()
        item['h1'] = response.xpath('normalize-space(/html/body/h1/text())').get()
        item['h2'] = response.xpath('normalize-space(/html/body/h2/text())').get()
        item['h3'] = response.xpath('normalize-space(/html/body/h3/text())').get()
        yield item

I don't know how to adapt the process_request and _requests_to_follow functions.
Do you recommend to use await asyncio.sleep(1) in parse function to prevent being rate limited?
Thanks a lot!!!

I tested again this spider with scrapy-splash and it works as expected. The first request is processed with Splash and the crawler follows the rest the links according to the rules set.

When I use start_requests, it only crawls the links set in start_urls.

That is because you're handling the start response(s) with the defined callback (parse_item), producing its results directly, while the default implementation does additional processing to look for rule matches. You could use CrawlSpider.parse_start_url if you needed to do your own processing with the initial response, while also allowing the CrawlSpider to follow its rules.

I tested again this spider with scrapy-splash and it works as expected. The first request is processed with Splash and the crawler follows the rest the links according to the rules set.

I'm not sure I follow, could you elaborate further?

Thank you for your help! I'm going to try what you suggested.
The issue is better explained here: https://stackoverflow.com/questions/45886068/scrapy-crawlspider-splash-how-to-follow-links-through-linkextractor

I enabled HTTP caching to check the response body and tried 4 combinations always with:
    rules = (
        Rule(LinkExtractor(allow="^https://www.domain.org/category/"),
        callback="parse_item", process_request="pyppeteer_request", process_links="filter_links", follow=True),
    )

    def pyppeteer_request(self, request, response):
        request.meta.update({"pyppeteer": True},)
        return request

The response body of links set in start_urls become encoded. Links set in start_urls don't go through parse_item.

    def parse_start_url(self, response):
        yield Request(url=response.url, meta={"pyppeteer": True},)

The response body of links set in start_urls become encoded. All links go through parse_item but the links set in start_urls aren't processed through pyppeteer: I tried to scrape a node element created with Javascript and the result was "".

    def parse_start_url(self, response):
        yield Request(url=response.url, meta={"pyppeteer": True}, callback=self.parse_item,)

All links are processed with pyppeteer but the links set in start_urls don't go through parse_item.

    def start_requests(self):
        for url in self.start_urls:
            yield Request(url=url, meta={"pyppeteer": True}, )

Only the links set in start_urls are processed: through pyppeteer and parse_item. The rest are not followed.

    def start_requests(self):
        for url in self.start_urls:
            yield Request(url=url, meta={"pyppeteer": True}, callback=self.parse_item, )

Thank you for your help! I'm going to try what you suggested.
The issue is better explained here: https://stackoverflow.com/questions/45886068/scrapy-crawlspider-splash-how-to-follow-links-through-linkextractor

Someone mentioned there "In the github issues, some users just redefine the _request_to_follow method in their class."

This did it:
    def start_requests(self):
        for url in self.start_urls:
            yield Request(url=url, meta={"pyppeteer": True},)

    def parse_start_url(self, response):
        return self.parse_item(response)

Thanks a lot!!!!!!


Add (failing) {In,Out}_channel linearization tests

Note: this depends on #5, which is why I open it as a draft PR.
This adds linearizability testing for a few functions of the new Stdlib modules In_channel and Out_channel. As of now these functions are not thread-safe, so the tests fails, sometimes with segfaults (due to concurrent close and output functions in Out_channel).
Left to do:

[ ] Update dune file appropriately once the fate of #5 is settled.
[ ] Determine how this (currently failing) can be integrated properly into the test suite.
[ ] Maybe enrich the test to cover more functions once their precise contract is decided by the compiler team (fix, or not fix and document, etc.)

Closing as this is now superseeded by #270.


CSL-1277 Make wallet.sh almost usable

You can use wallet.sh and it will generate a proper command now.
However, I don't know how to properly execute it from bash.
So current approach is to copy it and execute manually.

seems that nobody will review it after all :(


Chat UI tweaks

Simple fix for #2376
Contains

Chat overlay now shows up to last 6 messages
Sending a message now closes the chat window and opens the chat overlay instead of remaining focused on the text field
Tweaked base time values of chat overlay so it lasts longer before fading out

How to test
Open up a game and type something in chat. Here's an image of the updated chat overlay:

Outstanding before merging
Some ideas I had but not really sure if they should be put in the game:

Settings for max no. of lines to be shown on overlay
Similar to other games, where the chat history is separate from the text box and pressing the chat button just makes the text field visible and turns the chat history scrollable (my concern with this is that it might take up too much space since the new messages appear at the bottom but we could change this such that new messages appear on top)

I adjusted the chat system based on my own judgement and experience with other games so definitely let me know if you would like any changes and I can add them in 🙂.

Hooray Jenkins reported success with all tests good!

Hooray Jenkins reported success with all tests good!

Whoops, put my last comment in the first commit :)
Just give me a short ping if you want to do some more stuff on the code, otherwhise I think we can merge this one tomorrow :)

@oniatus: Ah, didn't think about that. Would like to deal with it before it gets merged. I don't think we should add a scrollbar since that's already present in the full chat history or a char limit since that might lead to one message filling the whole overlay.. It does seem strange that there's no limit for chat messages - what do you about limiting all messages sent to 100 chars? 🙂

@iojw I think the overlay has to deal with the message size, not vice versa :) If one wants to copy-paste a novel or a large link, why not.
But as the issue was about improving the visibility and adding a fade out, this is okay for the moment.
We can add a follow-up issue about a maximum size or more polishing like different or configurable fade out times if you want to continue on this 👍

The only thing I can think about regarding this is having a fade to a larger text area (with previously buffered messages) that can only be seen when trying to type stuff. Probably, as you said, out of the current scope though

@oniatus Cool, I guess you can just merge this in then 🙂
@portokaliu That should be what what happens currently - this overlay is only shown when the player is not actively typing and someone else sends a message. When the player is actively typing, there's a larger scrollable view visible with the full chat history.

Hooray Jenkins reported success with all tests good!


Saliency map

Hi, could you please share the code for calculating saliency maps? Thanks.

Hi, please refer to the files for calculating saliency maps.
saliency.zip

Thank you so much.  It helps me a lot.


added an option for dump_object to accept a id list file

I have a long list of ids I want to dump, so I made this minor change to support loading a list of ids from a file. Hopefully it will be useful for others.

@yifanzhang This seems unnecessary form a shell I can do this:
./manage.py dump_object `cat mylistofids.txt`

and get the same effect.
Does this patch add to this?

yes, that's true. I will close the pull request.


isMockedFunction returns wrong value after object is spied on twice

Describe the bug
Spy on an object twice and call restoreAllMocks, then isMockedFunction still thinks that it is a mock function.
Reproduction
https://stackblitz.com/edit/vitest-dev-vitest-bhbdof?file=test%2Fbasic.test.ts
import { describe, expect, it, vi } from "vitest";

const fooService = { foo: () => "foo" };
describe("fooService", () => {
  describe("foo", () => {
    it("is not a mock functon after 1 spy", () => {
      vi.spyOn(fooService, "foo").mockImplementation(() => "bar");
      vi.restoreAllMocks();
      expect(vi.isMockFunction(fooService.foo)).toBe(false);
    });
    it("it not a mock function after 2 spys", () => {
      vi.spyOn(fooService, "foo").mockImplementation(() => "bar");
      vi.spyOn(fooService, "foo").mockImplementation(() => "bar");
      vi.restoreAllMocks();
      expect(vi.isMockFunction(fooService.foo)).toBe(false);
    });
  });
});

 ❯ test/fooService.test.ts (2)
   ❯ fooService (2)
     ❯ foo (2)
       ✓ is not a mock functon after 1 spy
       × it not a mock function after 2 spys

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯ Failed Tests 1 ⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯

 FAIL  test/fooService.test.ts > fooService > foo > it not a mock function after 2 spys
AssertionError: expected true to be false // Object.is equality

- Expected
+ Received

- false
+ true

 ❯ test/fooService.test.ts:15:49
     13|       vi.spyOn(fooService, "foo").mockImplementation(() => "bar");
     14|       vi.restoreAllMocks();
     15|       expect(vi.isMockFunction(fooService.foo)).toBe(false);
       |                                                 ^
     16|     });
     17|   });

System Info
System:
    OS: Linux 5.0 undefined
    CPU: (8) x64 Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
    Memory: 0 Bytes / 0 Bytes
    Shell: 1.0 - /bin/jsh
  Binaries:
    Node: 18.20.3 - /usr/local/bin/node
    Yarn: 1.22.19 - /usr/local/bin/yarn
    npm: 10.2.3 - /usr/local/bin/npm
    pnpm: 8.15.6 - /usr/local/bin/pnpm
  npmPackages:
    @vitest/ui: latest => 2.0.5
    vite: latest => 5.4.2
    vitest: latest => 2.0.5

Used Package Manager
npm
Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

I think it's a bug with https://github.com/tinylibs/tinyspy. It restores the previous property decorator, not the original one. Maybe if the property is already spied, we need to return the spy instead of reapplying the spy.


Unable to generalize a type variable. It is not unranked - From typed argument, to polymorphic, to typed

This code works fine.
working ellie
This does not.
busted ellie
Elm version 0.18
The difference is in the polymorphic argument in func2's annotation.
Going from a known type to a polymorphic type and back to a known type seems to cause an issue with the type inference algorithm.

It looks like something went wrong with the type inference algorithm.
Unable to generalize a type variable. It is not unranked.

Note - This only happens when the known type is a type alias, swapping Person for a Bool for example doesn't cause the issue.
This is most likely relevant to #1613

Tracking in #1613. Thanks for the report!

Based on commit 4b25980d93ada12236c794f35570e197be82f787, I am now seeing the following error in my development build!

Note: You may see extra qualifiers on types in this error. That is part of the dev build, but should not appear in the final thing.


Italian Translation

Hi. Thanks! Can you update these strings to the updated english file? Thanks!

Of course. I'm gonna push an update soon.


Impossible to POST store edit page without selecting image

When I click submit button on store edit page without selecting image, bellow error was appear in the page.

Uploaded file is not an image. Please upload an image file.

I guess it is related to #122 or #123.
May I assign you to this issue, @cdepillabout ?

Good catch, I'll fix this.

Memo: /store/coupon/create and /store/coupon/edit page is supposed to be fixed.


Add the required neutered_specs arg to PrefixSupport calls

Fixes #56
I simply added neutered_specs args to the conda.core.link.PrefixSupport calls.
 Both work. The instructions are same for both.

Whoops, just saw this in the fix_compat branch by @wolfv:
https://github.com/QuantStack/mamba/blob/9c91656b5d30e64d001e15adc4639d2f403c1083/mamba/mamba.py#L158
FYI, there is another PrefixSetup call that is included in my PR that should be changed as well.

thanks, yours is better!
I'll make a dot release today.


sorry, but this really annoys me :3

huh, thought i had commented that out when Paper did their Timings deprecation stuff


hotfix: exported overlays incompatible with emacs-overlay

~depends on #468~
attempts to address #464
this probably is not the way to go in the long run. personally, i don't use the exported overlays, but i do use emacs-overlay – as numerous people have noted in #464, recent changes to emacs-overlay are incompatible with the way exportOverlays works.

It seems that my problem with emacs-overlay isn't solved with this fix.
$ nix flake update
warning: updating lock file '/home/a12l/Long-Term/NixCFG/flake.lock':
[...]
• Updated input 'digga':
    'github:divnix/digga/29bbac0173859812893d777fdce204af83a231ea' (2022-05-16)
  → 'github:divnix/digga/6b0c0aa1ae0410960de8f3ae7168e1991783ecbb' (2022-05-21)
• Updated input 'emacs-overlay':
    'github:nix-community/emacs-overlay/334ba8c610cf5e41dfe130507030e5587e3551b4' (2022-05-09)
  → 'github:nix-community/emacs-overlay/7a5353c3d27749912df89d1083e9b675f70accb4' (2022-05-26)
• Added input 'emacs-overlay/flake-utils':
    'github:numtide/flake-utils/04c1b180862888302ddfb2e3ad9eaa63afc60cf8' (2022-05-17)
• Added input 'emacs-overlay/nixpkgs':
    follows 'nixpkgs'
direnv: loading ~/Long-Term/NixCFG/.envrc
direnv: using flake
error: value is null while a set was expected

       at /nix/store/wn1xry1ra2qmj74nl5idlgz7y4vhrq66-source/default.nix:180:6:

          179|
          180| } // super.lib.optionalAttrs (super.config.allowAliases or true) {
             |      ^
          181|   emacsGcc = builtins.trace "emacsGcc has been renamed to emacsNativeComp, please update your expression." emacsNativeComp;
(use '--show-trace' to show detailed location information)
direnv: nix-direnv: renewed cache
direnv: export ~XDG_DATA_DIRS

Can be sure the problem is here：https://github.com/divnix/digga/blob/main/src/mkFlake/fup-adapter.nix#L44

Closing in favor of #483


feat: remove init and setup scripts and use @npmcli/eslint-config

This also converts the project to use @npmcli/template-oss
BREAKING CHANGE: this removes the init and setup executables which are
now a part of @npmcli/template-oss.
Closes #5.

Closing and porting the relevant changes to @npmcli/eslint-config


[REQUEST] Find open file

Let's suppose you have several open files, like, on my workspace I have 1961 files. When I have to open a specific file (just open and then move to a specific line number) I need to use the scroll bar and find the file manually.
What if we have a search bar fixed on the Explorer, so we can type a file name and it starts to filter the files opened on the workspace?

@yuric18 we typically use our pickers for that purpose, have you tried? E.g. Ctrl+P to open any file or View  > Show All Editors


Problem: acceptance-test suite is not documented

Solution: add README.md in the root of the acceptance tests, unify Makefile and commands, remove more cached files when make clean is ran.

The docs about how to run the tests with Docker Compose should be updated in:
docs/contributing/source/dev-setup-coding-and-contribution-process/run-node-with-docker-compose.md
In fact, that page should maybe be re-written to use the make x commands rather than the Docker Compose commands.


Fix invalid domain error

The EIP domain should be lowercase vpc.

Fixes https://github.com/aws-samples/amazon-ecs-catsndogs-workshop/issues/35.


Right to Left slide menu not opening after DsiplayAlert

The slide menu is not opening after showing DisplayAlert in iOS . After closing the  DisplayAlert if I try to open a menu .then grayscale is showing.

Hi,
sylendra7
When an AlertDialog is presented, the "SlideMenuView" is not show when in "this.IsFullScreen = true;" mode
Solutions: I had to apply a fix to the code so that it could work for me. replace at the source SlideOverKitiOSHandler.cs where they are "UIApplication.SharedApplication.KeyWindow" with "UIApplication.SharedApplication.Delegate.GetWindow ()"
I applied the previous fix and it worked. let me know if it works for you.
Good luck.

Hi ,
@rmoscat  Thank you very much it was fixed ...
--Kind Regards
Sylendra


Delay creation of hook until dll is loaded

I’m trying to hook a dll using the C# example but the dll is only loaded when the API is used and then unloaded.
Does anyone have any suggestions please for delaying creating the hook until the dll is loaded or only while the dll is loaded?
Thanks

LoadLibrary?

Yes you could try hooking loadlibrary and check if the target module is being loaded or not.

Thanks, I'll give that a try

I've successfully hooked LoadLibrary and able to detect when the specific dll is loaded but how do I then create a hook into that dll?
There's a similar thread here https://stackoverflow.com/a/50975505 but unfortunately it doesn't explain how to apply the second hook. I don't have enough reps on stockoverflow to add a comment there unfortunately.
I'll be grateful for any help please. thanks.

You could load the library yourself before installing local hook

You also could hook FreeLibrary to prevent the DLL from being unloaded


Channel logo caching

Is your feature request related to a problem? Please describe.
Because I've more than one client (player) for my SAT>IP server, I want to have all downloads from my clients targeting my LAN. Therefore, my idea is to use the xTeVe server as a proxy for the playlist (M3U), EPG (xmltv) and images/logos. However, the current implementation only implements cache for the images referenced in the guide (xmltv). My objective is to cache logos too.
Describe the solution you'd like
My suggestion is to add support for caching the channel logos equal as the images of the xmltv guide.
Describe alternatives you've considered
My alternative is to download all logos in local, and then change the playlist URL. However, this is a huge task to do. If the tool could cache all the logos and use the local URL inside the "xteve.m3u" then it will be more easy to maintain our playlists.
Additional context
I think it has the same sense of caching images than caching the logos. Do you think so?

xTeVe project is not doing any feature requests or re-coding, please contact an active fork.


feat(dashmate): add core cli command

Expected Behavior

User should be able to easily invoke dash-cli commands from the dashmate
Current Behavior

User have to check core container id with docker ps and use it in the docker exec -it ... command
Possible Solution

Add a dashmate core cli command where you can pass a dash-cli command as an argument. Example:
$ dashmate core cli "getblockhash 1"
0000047d24635e347be3aaaeb66c26be94901a2f962feccd4f95090191f208c1

https://github.com/dashpay/platform/pull/1501


Get Started with the SAP BTP Command Line Interface (btp CLI) - tips and tricks for btp.exe as btp

Tutorials: https://developers.sap.com/tutorials/cp-sapcp-getstarted.html
Hello
could you provide a tip to alias .\btp.exe as btp in powershell ?
Thank you

Amaury

Hi @AmauryVanEspen
try new-alias btp <path-to-folder-with-btp.exe>\btp - hope that'll work!
Thanks for the feedback - I'll add this info to the tutorial.
Bonne journée,
Anna

Thank you for your feedback. The issue seems to be resolved, so I am closing the issue.
If you still have questions, feel free to reopen the issue.