clp-package: Package building platform's /etc/os-release and determine execution_container from the file.

References
Internally, it was found that when the CLP Package is built with container clp-core-dependencies-x86-ubuntu-jammy:main, running the package starting script (entry point <clp-package>/sbin/start-clp.sh leads to missing Python dependencies failures. Further investigation found that the failures indicates Python version discrepancy in the built package virtual environment and execution container. Previously, users could mitigate such discrepancy in the building environment versus the execution container by specifying a matching execution_container in clp-config.yml. However, the configuration field is not publicly documented and encouraged to be used. Instead, the CLP Package should include information about the building platform and determine which Docker image to generate the execution_container.
This PR depends on #321 which adds a GitHub workflow to build and push Ubuntu Jammy execution container to the GitHub Docker Registry.
Description

Package building platform's /etc/os-release.
In package starting script, determine execution_container name from the <clp-package>/etc/os-release file.
Add /etc/os-release to Taskfile  building platform dependent tasks to trigger rebuild when the building container changes.

Validation performed
Sanity test with Ubuntu Focal

Loaded container clp-core-dependencies-x86-ubuntu-focal:main and ran task under project root to build the package.
Started the package via <clp-package>/sbin/start-clp.sh.
Ran docker ps and observed all CLP component dockers created by IMAGE ghcr.io/y-scope/clp/clp-execution-x86-ubuntu-focal:main.CONTAINER ID   IMAGE                                                     COMMAND                  CREATED          STATUS          PORTS                                                                      NAMES
9724137d38bd   ghcr.io/y-scope/clp/clp-execution-x86-ubuntu-focal:main   "/opt/clp/bin/node /…"   47 seconds ago   Up 46 seconds                                                                              clp-webui-2d7d
68a64a3bcc19   ghcr.io/y-scope/clp/clp-execution-x86-ubuntu-focal:main   "python3 /opt/clp/li…"   47 seconds ago   Up 46 seconds                                                                              clp-search_worker-2d7d
13ef53be52ba   ghcr.io/y-scope/clp/clp-execution-x86-ubuntu-focal:main   "python3 /opt/clp/li…"   47 seconds ago   Up 46 seconds                                                                              clp-compression_worker-2d7d
613fc5982a70   ghcr.io/y-scope/clp/clp-execution-x86-ubuntu-focal:main   "python3 -u -m job_o…"   48 seconds ago   Up 47 seconds                                                                              clp-search_scheduler-2d7d
9ff6bf1c2e70   ghcr.io/y-scope/clp/clp-execution-x86-ubuntu-focal:main   "python3 -u -m job_o…"   48 seconds ago   Up 47 seconds                                                                              clp-compression_scheduler-2d7d
...

Test with Ubuntu Jammy

Loaded container clp-core-dependencies-x86-ubuntu-jammy:main and ran task under project root to build the package.
Started the package via <clp-package>/sbin/start-clp.sh.
(TODO: re-validate once PR #321 is merged). Shall run docker ps and observe all CLP component dockers created by IMAGE ghcr.io/y-scope/clp/clp-execution-x86-ubuntu-jammy:main.

It's not entirely clear to me that how we will support custom container name and container tags

Users can configure a string field execution_container to specify a custom container image in clp-config.yml just like what they previously could do.


dependency: Drop dependencies on ArchivalMMR and rusty-leveldb

These libraries were only required by test cases where only accumulators were needed. The archival MMRs were used to generate the MMR accumulators. Now we generate the MMR accumulators directly.

LGTM


Internal compiler error - unstable fingerprints

Describe the bug
There's an issue with incremental compilation that prevents building tests multiple times on latest nightly.
To Reproduce
Run integration tests, make a change in the code and rerun.
Additional context
Tracking issue: https://github.com/rust-lang/rust/issues/83291

@gregdhill is that issue still a problem? Haven't noticed that on any of the latest builds.


Cannot login on Woodpecker paired with gitea

Component
server
Describe the bug
Hello,
I have a functionnal instance of woodpecker CI working with a gitea instance. About one time per day I get stuck on the login page, clicking on connect redirects to the same page.

I find this log on the server container:
{"level":"error","repo_id":"1","pipeline_id":"49","workflow_id":"49","error":"stream: not found","time":"2024-04-18T08:18:24Z","message":"done: cannot close log stream for step 441"

I have tried to disconnect from gitea to force relogin and flush site data in browser from both gitea and woodpecker but without success.
The strange thing is that on the same browser if I switch to private mode or I change the browser I can login by beeing redirected to gitea.
What do you guys think?
System Info
woodpecker CI version 2.4.1
gitea version 1.21.10
firefox 124.0.2

Additional context
No response
Validations

[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Checked that the bug isn't fixed in the next version already [https://woodpecker-ci.org/faq#which-version-of-woodpecker-should-i-use]

The mentioned error is related to log / event streaming and shouldn't be relevant.
Woodpecker syncs all your projects from gitea on login. There might be a problem with it in your case.

Never encountered the problem since a while. I made a gitea from 1.21.10 to 1.21.11, maybe the problem was there.


Listener based on style

I know this sounds weird, but I'm looking at a website that has no div names, and so on, in a nutshell, a nightmare. With this in mind, I found a way to segment some of the data I need; the catch is, I need to segment all divs which contain a part of a certain style, specifically, background-color:#FFFFFF:
e.g.

Any hints on how to do this? Not only I cant find how to query based on style, but I'm also failing to find a "contains" operation for the listener.
Thanks in advance

Feature request: I have the same issue, except items use display:none.


Basic authentication middleware?

Hi,
I want to be able to use basic auth to obtain authorization from an oath service, as in the client offers the user and password through basic auth, rather than through a login page.
I already tried implementing a basic authentication middleware and it seems to be working for the most part, but we should probably discuss the feature here anyway.

Hi @bogdanpetrea unfortunately basic authentication is out of scope and we don't have any plans do add it. Still, the code is open source so you can tweak it to your own needs.
I'm closing this for now. But if in the future you see any other improvements or bugs, please open a Jira (https://issues.jboss.org/browse/KEYCLOAK)

Hi!
Would you care to reconsider closing this?
The use case is as follows: the proxy sits in front of a git server; users should be able to clone their repos using their user/password sent using basic auth.
I see that there's as POST /oauth/login endpoint which allows logging in users using user/password combo (by using password as grant_type). Is there a specific reason for not allowing this trough HTTP Basic auth?
Thanks!


Add agat sp statistics

Description
add agat_sp_statistics
Issue ticket number
Closes #xxxx

Checklist before requesting a review

[x] I have performed a self-review of my code

[x] Conforms to the Contributing guidelines

[x] Proposed changes are described in the CHANGELOG.md

[x] I have tested my code with viash ns test --parallel -q <name or namespace>

Check the correct box. Does this PR contain:

[ ] Breaking changes
[x] New functionality
[ ] Major changes
[ ] Minor changes
[ ] Documentation
[ ] Bug fixes

How to deal with an argument that can take multiple type?
The argument gs can take either a file either a number, so I gave it type string but I am not sure if that is the best way to handle it.
     - name: --gs
        alternatives: [-f, -g]
        description: |
          This option inform about the genome size in order to compute more statistics.
          You can give the size in Nucleotide or directly the fasta file.
        type: string

How to deal with an argument that can take multiple type? The argument gs can take either a file either a number, so I gave it type string but I am not sure if that is the best way to handle it.
     - name: --gs
        alternatives: [-f, -g]
        description: |
          This option inform about the genome size in order to compute more statistics.
          You can give the size in Nucleotide or directly the fasta file.
        type: string

I would split it into 2 arguments.


Support Request: Expanding LinqyCalculator example

This is an awesome library to help in this very complex topic!
I tried to expand the Sprache/samles/LinqyCalculator/ExpressionParser.cs to provide more functions than contained in System.Math. I was somehow unable to achieve that:

Functions could have no parameters.
Functions would accept strings, so that e.g. customFunc("Hello", "World") could be parsed (I was able to add "customFunc", but only with double values as parameters)

Can you maybe explain and show how I could achieve this?

Hello! Sorry for being a bit late to reply here, I think I can help a bit.
In order to get functions without parameters, you'll need to make the expr parser within the Function parser optional. This has a consequence when you pass the expressions into CallFunction since you'll need to handle the case where there are no parameters. This is how I rewrote the Function parser with that:
static readonly Parser<Expression> Function =
    from name in Parse.Letter.AtLeastOnce().Text()
    from lparen in Parse.Char('(')
    from expr in Parse.Ref(() => Expr).DelimitedBy(Parse.Char(',').Token()).Optional()
    from rparen in Parse.Char(')')
    select CallFunction(name,
        expr.IsDefined
        ? expr.Get().ToArray()
        : Array.Empty<Expression>()
    );

In order to support strings, you'll need to add a new parser for string constants, and the interesting work would be how to integrate that constant. I'm assuming that you don't want the strings to be able to be added as part of an arithmetic expression, but rather just that they can be used as an argument in a function. In order to do that, you should be able to update the Function parser to derive its argument-expressions either from Expr or your new string constant parser. Here's my implementation of that:
static readonly Parser<Expression> StringConstant =
    from quote in Parse.Char('"')
    from remainder in Parse.Until(Parse.AnyChar, Parse.Char('"')).Text()
    select Expression.Constant(remainder);

static readonly Parser<Expression> Function =
    from name in Parse.Letter.AtLeastOnce().Text()
    from lparen in Parse.Char('(')
    from expr in StringConstant.XOr(Parse.Ref(() => Expr)).DelimitedBy(Parse.Char(',').Token()).Optional()
    from rparen in Parse.Char(')')
    select CallFunction(name,
        expr.IsDefined
        ? expr.Get().ToArray()
        : Array.Empty<Expression>()
    );


Improve/designer news example

I guess we could do some more refactor and it doesn't add a big feature to the code, but it works! :dancers:

I had a slightly different idea of this, I'll make a branch and send you a PR to your PR.
Looks awesome anyway :heart:

I can't get the comments to show, it says
2015-03-27 07:44:43.809 DesignerNews[6416:120824] *** -[NSKeyedUnarchiver initForReadingWithData:]: data is NULL

Oh, I fixed that... I'll try it again... :/

Fixed two problems, I guess @NSElvis that, if we fix the problem you put today in Property Mappers, then we could do it the other way, also, we could add a label with the author and the date into the comments, this was just a quick way to do it! :snail:

Damn, still get the error


How to get the Female voice in text-to-speech?

I am using the built-in feature for text-to-speech (speechSynthesis)
I need the Female voice and I got that using voiceUrl: Google US English
But that speaks only about 2 sentences.
What is the problem?
This is my Next.js Code
        const utterance = new SpeechSynthesisUtterance(message.content);
        // const voices = speechSynthesis.getVoices().filter(voice => voice.lang.startsWith("en") && voice.name.includes('Female'));
        console.log(speechSynthesis.getVoices())
        const voices = speechSynthesis.getVoices().filter(voice => voice.voiceURI === 'Google US English');
        if (voices.length > 0) {
          utterance.voice = voices[0];
        }
        window.speechSynthesis.speak(utterance);
        setSpeaking(true);

Leon does not use the Web Speech API. Hence, this issue isn't related to Leon.


Add avg method with tests

Added an avg method to calculate the mean of a given attribute.

I'm not sure we need this, but if we do, why not average?

I noticed it was possible in the query builder, named avg, but not in Collection.
I've been using it to find the average of model accessors for non db data.

Not needed. This sort of thing belongs in your own code. We don't want to bloat the core.


Applicant/Manager - Options for applicant confirming language requirements

Description
As per issue #919, some positions accept English or French or both for their language requirements. The options for when the applicant is confirming they meet the language requirements needs to be updated for this scenario. This will include 3 checkboxes, and the results will need to be displayed on the application preview (and on the application view for managers)
- English copy for final:

[ ] I have strong reading, writing and verbal communication skills in English
[ ] I have strong reading, writing and verbal communication skills in French
[ ] I have strong reading, writing and verbal communication skills in both English and French

- French copy for final:

[ ] Je possède de solides compétences en lecture, en rédaction et en communication verbale en français.
[ ] Je possède de solides compétences en lecture, en rédaction et en communication verbale en anglais.
[ ] Je possède de solides compétences en lecture, en rédaction et en communication verbale en français et en anglais.

I think these should be radio buttons and not checkboxes? @JasmitaChawla

Yeah you're right, I'll change it

@JasmitaChawla can you look into whether or not we should always display these checkboxes or if we should only do it for the "English or French" special case. I'm inclined to go with whatever the devs think is easiest, but thought the UX team might have a stronger preference.

I think it's fine if we always display them. Even if it is for an English position, seeing all the options here could help clear any uncertainties from the job poster.


Multiple cursor undo of delete operations

Delete operations with multiple cursors are undone one by one. They should be undone all together.

absolutely right, works great for me.


I think it would help if you said what the bugs are.

I hope they don't plan on fixing whatever bugs you're encountering.

Maybe they're referring to an open issue they made? https://github.com/RipMeApp/ripme/issues/1500 anyway, not productive, you're just wasting the time they could be spending fixing bugs on dealing with your bs.


Fix up for CountAttributedType and TypeCoupledDeclRefInfo handlers

CountAttributedType and TypeCoupledDeclRefInfo are new Clang type and type metadata created for types with the 'counted_by' attribute, which shouldn't be accessible from Swift right now. Hence, making them unreachable.

@swift-ci

@swift-ci please test

Merging it given that macOS build succeeded. The test failures are not caused by this change.


Message#isImage() is returning true on videos

General Troubleshooting

[x] I have checked for similar issues.
[x] I have updated to the latest JDA version.
[x] I have checked the branches or the maintainers' PRs for upcoming bug fixes.

Bug Report
Message#isImage() is returning true on videos, even though it probably shouldn't.

Expected Behavior
I would expect it to return false on video files.

Code Example or Reproduction Steps
import net.dv8tion.jda.core.JDA;
import net.dv8tion.jda.core.JDABuilder;
import net.dv8tion.jda.core.entities.Message;
import net.dv8tion.jda.core.events.message.MessageReceivedEvent;
import net.dv8tion.jda.core.hooks.ListenerAdapter;

import javax.security.auth.login.LoginException;

public class scratch extends ListenerAdapter {
    public static void main(String[] args) throws InterruptedException, LoginException {
        JDA jda = new JDABuilder("token").build();
        jda.awaitReady();
        jda.addEventListener(new scratch());
    }

    @Override
    public void onMessageReceived(MessageReceivedEvent e) {
        for (Message.Attachment a : e.getMessage().getAttachments()) {
            System.out.println(a.getUrl() + "\n" + a.isImage());
        }
    }
}

Outputs:
https://cdn.discordapp.com/attachments/570771524697718810/605885966879817760/big-buck-bunny_trailer.webm
true
https://cdn.discordapp.com/attachments/570771524697718810/605890023232897024/Replay_2019-05-31_15-55-30.mp4
true

even though it is a video file.

Exception or Error
N/A

This is most likely due to how JDA checks if the attachment is an image.
https://ci.dv8tion.net/job/JDA/javadoc/net/dv8tion/jda/core/entities/Message.Attachment.html#isImage--

Does discord actually provide a way to differentiate between images and videos in a reliable way? Or are we going to have to rely on checking the extension which is part of Attachment#getFileName()?

From what I know does Discord not provide a reliable way to check the type of attachment.


prettier, linting, fixed tests

When the FE is started, there are a couple of warnings, such as:
WARNING in<EMAIL_ADDRESS>Module Warning (from ./node_modules/source-map-loader/dist/cjs.js):
Failed to parse source map from<EMAIL_ADDRESS>file: Error: ENOENT: no such file or directory, open<EMAIL_ADDRESS>Are some source maps missing after the update? Do we need them?

LGTM. (Rebased the other BE stuff temporarily onto this branch and everything still works)

Can you run another "lint:fix" on your branch? --> ArcticlePage.test.txt

Can you run another "lint:fix" on your branch? --> ArcticlePage.test.txt

done

When the FE is started, there are a couple of warnings, such as:
WARNING in<EMAIL_ADDRESS>Module Warning (from ./node_modules/source-map-loader/dist/cjs.js): Failed to parse source map from<EMAIL_ADDRESS>file: Error: ENOENT: no such file or directory, open<EMAIL_ADDRESS>Are some source maps missing after the update? Do we need them?

done


ERROR CHECKPOINT FAILED FOR HEIGHT 65000

I've compiled conceal successfully and have tried many times but keep getting 'ERROR CHECKPOINT FAILED FOR HEIGHT 65000.Check the attached image file. Looking at block explorer the 'FETCHED HASH' is correct for height 65000 while the 'EXPECTED HASH' is for a different height. I also tried deleting p2pstate.bin and resync and also resync from 0 still same error. How to fix this?

Hi madouz,
It's fixed. There was a wrong hash on the config file for block 65000.
I am sorry for any inconvenience caused. Thanks for pointing this out.
Pop in our discord and i will be happy to tip you for your troubles.
Thank you.

This issue is now sorted out and post closed.

Not fixed. Still got same error.

Yes, it is. Have you rebuild the code?
The code changes need to be rebuild to take effect, otherwise you will be using the previous code version (with the issue). If your daemon keeps stuck after rebuild, try to delete the blockdata folder (".conceal") and download data again.

Hi,
I can confirm that it works for me. I compiled again from source, and I passed 65,000 @madouz, please check and let us know.

Okay it worked. Thought config was changed peer side and used the old binary. Thanks.


Fail gracefully on non-WebGL2 browsers (i.e. iOS or Safari)

Projects are starting to use Neuroglancer to show data to a very broad audience. While we can explain the browser compatibility as clearly as possible, at the end of the day people are not all going to read carefully before clicking links (e.g. if they see a link on twitter). It would be great to not discourage interested people coming in with iOS or Safari if Neuroglancer had an informative error page that let them know how to access the link.

This remains easy and extremely important for data sharing.

Fixed in master as of 93d9089

Thank you!


Strategy.bybit_reset_position_leverage_long() missing 1 required positional argument: 'max_leverage'

Exception in thread Thread-20 (run_single_symbol):
Traceback (most recent call last):
File "/home/bot/.pyenv/versions/3.11.0/lib/python3.11/threading.py", line 1038, in _bootstrap_inner
self.run()
File "/home/bot/.pyenv/versions/3.11.0/lib/python3.11/threading.py", line 975, in run
self._target(*self._args, **self._kwargs)
File "/home/bot/directionalscalper/directionalscalper/core/strategies/bybit/multi/bybit_mfirsi_trend_rotator.py", line 234, in run_single_symbol
self.bybit_reset_position_leverage_long(long_pos_qty, total_equity, best_ask_price, max_leverage)
TypeError: Strategy.bybit_reset_position_leverage_long() missing 1 required positional argument: 'max_leverage'
Futures balance:<PHONE_NUMBER>7
symbols_allowed from config: None

v2 works btw


authDb support

I tried connecting to a db ("called mydB") by using a authDb (called "admin") but I cannot establish a successfull connection.
My connection string is the folllowing one:
mydb_adminuser:asecurepassword@localhost:20900/myDb?authSource=admin

This is the result which is outputed by db ping command:
 { [MongoError: auth failed]
  name: 'MongoError',
  message: 'auth failed',
  ok: 0,
  errmsg: 'auth failed',
  code: 18 }

The authSource parameter is a defined standard in monodb core driver but somehow it doesn´t work in
promised-mongo.
The same connection string (with real credentials) works perfectly in mongoose.

Is there a fix for it? I'm also having this issue


Multiplication and division of vector by rotation is marked as an invalid expression

Seen in version 0.1.9.
Example:
// 45-degree rotation around the Z (up) axis
rotation r = llEuler2Rot(<0, 0, 45> * DEG_TO_RAD);

// Vector whose direction is 1 meter to the east
vector v = <1, 0, 0>;

// Vector whose direction is north-east
vector rotated = v * r; // <0.707107, 0.707107, 0.000000>

// Vector whose direction is south-east
// (division performs a rotation in the opposite direction)
vector rotated2 = v / r; // <0.707107, -0.707107, 0.000000>

default {
}

As shown in IntelliJ IDEA:

The wiki says it should work; the same code snippet is there: https://wiki.secondlife.com/wiki/Category:LSL_Vector#Rotation

I failed to get the project to run, but I guess adding this in LslPrimitiveType will fix it:
        // <1, 0, 0> * llEuler2Rot(<0, 0, 45> * DEG_TO_RAD) == <0.707107, 0.707107, 0>
        // <1, 0, 0> / llEuler2Rot(<0, 0, 45> * DEG_TO_RAD) == <0.707107, -0.707107, 0>
        if ((operation == LslTypes.MULTIPLE || operation == LslTypes.MULTIPLE_ASSIGN || operation == LslTypes.DIVIDE || operation == LslTypes.DIVIDE_ASSIGN) && this == VECTOR && other == QUATERNION) {
            return VECTOR
        }

I failed to get the project to run
I managed to run it by updating org.jetbrains.intellij from 1.8.0 to 1.13.3! I don't know what the root cause was, but it worked. For the record, the error was:

'org.jetbrains.intellij.tasks.IntelliJInstrumentCodeTask' property 'compilerClassPathFromMaven' doesn't have a configured value

Looks like the fix worked:

Thank you very much!

:D


"Zlib::GzipFile::Error: [!] unexpected end of file"

Xcode: 9.0 (9A235)
version: v0.6.2

Zlib::GzipFile::Error: [!] unexpected end of file
https://github.com/giginet/xcprofiler/blob/a817a517b7620ca3ab0c4dc4063f1a259c73c7d9/lib/xcprofiler/derived_data.rb#L66

We had this error occasionally on our CI server.
Is there any latest Xcode related problem?
Or should this library handle this kind of error as library error?
class Xcprofiler::Error < StandardError; end

begin
  Zlib::GzipReader.open(@path) do |gz|
    @lines = gz.read.split(/\r/)
  end
rescue => e
  raise Xcprofiler::Error.new(e)
end

🙏

I'll just close this issue. We have been disabling xcprofiler in our project so I can't tell if this is still a problem any more 🙏


API overhaul

Pull Request Test Coverage Report for Build 127058087

4 of 20 (20.0%)  changed or added relevant lines in 5 files are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-1.9%) to 61.553%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

cmd/api/server/users_handlers.go
2
3
66.67%

cmd/front-end/server/games_handlers.go
0
7
0.0%

cmd/api/server/user_games_handlers.go
0
8
0.0%

Files with Coverage Reduction
New Missed Lines
%

cmd/api/server/users_handlers.go
2
66.99%

Totals

Change from base Build 126486513:
-1.9%

Covered Lines:
317

Relevant Lines:
515

💛  - Coveralls


Make core.call_p a call primitive.

Thanks, @sharadmv ! Nice catch!

call_p is never used anywhere in the code. What is its purpose?

It's essentially the canonical example of a call with no extra constraints or features, i.e. it works with Python control flow and doesn't abstract its inputs, etc. It's been the basis for a lot of my work recently, namely remat and custom jvp/vjp stuff, all of which are calls but with different funny behaviors. I find it helpful to keep in as a reference, and in some ways much of JAX was designed around it.

It's also been the basis of a lot of @sharadmv's work, which is why he noticed this bug I suspect!


Add instructions for querying or adding a project-level SSH key

If you could add instructions for querying or adding a project-level SSH key, it would be most helpful.
I can't seem to make any progress here because I can't find a way to query the IDs of the project ssh keys, after adding them via the UI. The metal CLI also only lists user-level SSH keys.

The Equinix Metal Terraform provider has a datasource to retrieve a Project SSH key and its attributes

https://registry.terraform.io/providers/equinix/metal/latest/docs/data-sources/project_ssh_key

An example is now available to illustrate this
See commit 1f7567a


Logical fallacy removal

Description: a new chain to test and remove logical fallacies from model output in a chain if found
Issue: n/a
Dependencies: none
Tag maintainer: @hinthornw helped me in the past, not sure if this PR falls outside any maintainer area but feel free to maintain if so
Twitter handle: not on twitter - tag my git handle if any shout out needed j-space-b
Note: added documentation to docs/extras

reopening after fixing formatting


wip: encrypt / decrypt

alright this is looking good imo. I tested setting a password, removing the password, exporting with / without encryption

[ ] make it so you can get rid of the password
[ ] make sure it works with export

getting an error when I try to encrypt with no existing password. pretty sure it's not my fault, was working before

Existing password at the top should be removed if they're coming in from the "backup notification" flow. We know they're not going to have an existing password.

We'll probably have some users that forget their password. How should we handle that? Take them to the emergency page?

Existing password at the top should be removed if they're coming in from the "backup notification" flow. We know they're not going to have an existing password.

I agree this would be nice but requires a decent bit of logic to have a "referral page" so maybe just make an issue for now


Updated cloud/README.md to describe how to add new cloud provider

This is a first attempt. Adding a new cloud provider requires touching a number of different places. Would appreciate corrections.

This improves on #480

@deitch Thank you so much for your contribution to the kubicorn project! We really appreciate it.
This looks good to me. However, I would move this to project's documentation and then link it to all relevant READMEs. As you said, it requires touching a many different places, so I think having it in documentation would make more sense.

Sure @xmudrii . Happy to move it over there and just link to it from this README.

I moved it over, but that does make all of the links wrong, since they were relative to ./cloud/. Where is this stuff published? Should I just link to the absolute path of the GitHub repo?

@deitch Thanks for the fast response. Yes, linking it to the absolute path of repo is good enough.

Done.

@deitch Once again, thank you very much! It looks good to me. I'll go ahead and merge it.

Now we will find out how well they work as I implement Packet! :-)


Master does not take account node engine labels on initial agent connection

Master sends node information back to agent before agent  sends docker engine labels to master.
This is troublesome in situations where docker engine labels have a custom region label because the master will resolve overlay (weave) peer addresses using this label information. Basically this means that node tries to connect to other nodes via public ip which in most cases is not a valid assumption.

Maybe include the critical information from the node as GET parameters in the intiial Websocket connection request?

workaround: ssh in on of the nodes and docker restart kontena-agent

~never happens on azure since azure is so damn slow to start instances.

still present with 0.16.1.rc3 (fyi)


cs-5581-add-claim

had to change to get the ember build to work

https://github.com/cardstack/cardstack/pull/3753 sdk export
add polyfills

Closing this in favor of https://github.com/cardstack/boxel/pull/376. Will add the claim code there since testing claim is only small portion

Closing this in favor of https://github.com/cardstack/boxel/pull/376. Will add the claim code there since testing claim is only small portion


Complete freeze of homeassistant after activating Nabu Casa

Home Assistant release with the issue:

90.2
Last working Home Assistant release (if known):
This is only version I've tried Nabu Casa on
Operating environment (Hass.io/Docker/Windows/etc.):

Hass.io running on Ubuntu Server on amd64 (2009 mac mini)
Component/platform:

Nabu Casa
Description of problem:
After trying out nabu casa, have been getting random freezes of home assistant where it completely stops doing anything, logging, etc.
Problem-relevant configuration.yaml entries and (fill out even if it seems unimportant):
cloud:

Traceback (if applicable):
2019-04-24 22:25:11 ERROR (MainThread) [hass_nabucasa.remote] Can't update remote details from Home Assistant cloud
2019-04-24 22:25:39 ERROR (MainThread) [homeassistant.core] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/aiohttp/http_websocket.py", line 632, in ping
    await self._send_frame(message, WSMsgType.PING)
  File "/usr/local/lib/python3.7/site-packages/aiohttp/http_websocket.py", line 614, in _send_frame
    self.transport.write(header + message)
  File "uvloop/handles/stream.pyx", line 671, in uvloop.loop.UVStream.write
  File "uvloop/handles/handle.pyx", line 159, in uvloop.loop.UVHandle._ensure_alive
RuntimeError: unable to perform operation on <TCPTransport closed=True reading=False 0x56014e5f4ab8>; the handler is closed
2019-04-24 22:25:40 DEBUG (SyncWorker_5) [botocore.utils] Caught exception while trying to retrieve credentials: HTTPConnectionPool(host='[IP_REDACTED]', port=80): Max retries exceeded with url: /latest/meta-data/iam/security-credentials/ (Caused by ConnectTimeoutError(<botocore.awsrequest.AWSHTTPConnection object at 0x7f43569bca90>, 'Connection to [IP_REDACTED] timed out. (connect timeout=1)'))
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connection.py", line 134, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/connection.py", line 88, in create_connection
    raise err
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/connection.py", line 78, in create_connection
    sock.connect(sa)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 544, in urlopen
    body=body, headers=headers)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 349, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 130, in _send_request
    self, method, url, body, headers, *args, **kwargs)
  File "/usr/local/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 157, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 242, in send
    return HTTPConnection.send(self, str)
  File "/usr/local/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connection.py", line 155, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connection.py", line 139, in _new_conn
    (self.host, self.timeout))
botocore.vendored.requests.packages.urllib3.exceptions.ConnectTimeoutError: (<botocore.awsrequest.AWSHTTPConnection object at 0x7f43569bca90>, 'Connection to [IP_REDACTED] timed out. (connect timeout=1)')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/adapters.py", line 370, in send
    timeout=timeout
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 597, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/retry.py", line 271, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
botocore.vendored.requests.packages.urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='[IP_REDACTED]', port=80): Max retries exceeded with url: /latest/meta-data/iam/security-credentials/ (Caused by ConnectTimeoutError(<botocore.awsrequest.AWSHTTPConnection object at 0x7f43569bca90>, 'Connection to [IP_REDACTED] timed out. (connect timeout=1)'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/botocore/utils.py", line 174, in _get_request
    response = requests.get(url, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/api.py", line 69, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/api.py", line 50, in request
    response = session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/sessions.py", line 465, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/sessions.py", line 573, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/adapters.py", line 419, in send
    raise ConnectTimeout(e, request=request)
botocore.vendored.requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='[IP_REDACTED]', port=80): Max retries exceeded with url: /latest/meta-data/iam/security-credentials/ (Caused by ConnectTimeoutError(<botocore.awsrequest.AWSHTTPConnection object at 0x7f43569bca90>, 'Connection to [IP_REDACTED] timed out. (connect timeout=1)'))

Additional information:
About 2-3 log messages later, the whole thing is completely frozen.

botocore.vendored.requests.exceptions.ConnectTimeout: HTTPConnectionPool(host='[IP_REDACTED]', port=80): Max retries exceeded with url: /latest/meta-data/iam/security-credentials/ (Caused by ConnectTimeoutError(<botocore.awsrequest.AWSHTTPConnection object at 0x7f43569bca90>, 'Connection to [IP_REDACTED] timed out. (connect timeout=1)'))

Please do not redact this IP address. Your instance has problem connect to Amazon Web Service used by Nabu Casa.

Sorry, I didn't want to bother cross referencing with all possible publicly identifiable addresses for me.. Here it is: <IP_ADDRESS>

That is not your address.
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-instance-metadata.html

Is that one stack trace?
Can you post a list of all components they you run?

It's worth noting that I haven't had any network/internet issues in months, and that during this crash there was no problem with the internet whatsoever. I was running with zero connection issues the last 6 months over an SSL connection without Nabu Casa and it was fine, problems started right after activating Nabu Casa. I do run other things on the server, but again there was zero issue before nabu casa.
Here's the log from now (not same as one with errors I sent you though):
home-assistant.log.zip
My config is available here, recent enough to know what components I'm running.
https://github.com/scstraus/home-assistant-config
Here's cloudping output (internet connection right now is definitely worse than when I had the issue I sent). I'm located in Prague, Czech Republic.

Region
Latency

US-East (Virginia)
162 ms

US East (Ohio)
180 ms

US-West (California)
194 ms

US-West (Oregon)
456 ms

Canada (Central)
763 ms

Europe (Ireland)
73 ms

Europe (London)
87 ms

Europe (Frankfurt)
94 ms

Europe (Paris)
94 ms

Europe (Stockholm)
100 ms

Asia Pacific (Mumbai)
153 ms

Asia Pacific (Osaka-Local)
256 ms

Asia Pacific (Seoul)
285 ms

Asia Pacific (Singapore)
207 ms

Asia Pacific (Sydney)
1083 ms

Asia Pacific (Tokyo)
304 ms

South America (São Paulo)
318 ms

China (Beijing)
287 ms

China (Ningxia)
302 ms

AWS GovCloud (US-East)
170 ms

AWS GovCloud (US)
257 ms

(I'd say this is a worst case scenario because it's heavily raining and I use a microwave internet connection). I'm pretty sure that when I turn off Nabu Casa, all these issues will stop.. I will probably have to do it soon as the freezing is starting to be annoying. Let me know soon if you want anything else and I will switch back to SSL.

Do you use the stream component? There is an issue with shell command they can block the instance.
Well, I can't see anything they going wrong on your logs. My first idea was that the socket block because of network error but on your first log, there was no nabucasa remote connection available like on your second log. Maybe you can confirm that, if you are connected to cloud but turn off the remote connection and it will hang too?
Can you try it with 0.92 ?

No, I don't use the stream component.  Actually today I started to notice periods in my speedtest sensor where my upload speeds were going down to just a few kbps. I contacted my ISP and they confirmed that they have been fighting off an attack the last few days and it's been leading to intermittent outages. I guess I just hadn't noticed it directly while using it.. It's strange that I was also getting hangs when accessing on the local network, but I suspect it was probably dropbox who had been eating a lot of CPU and memory, I suspect also due to the internet issues.. I will keep monitoring the situation and see if it continues. I'm spinning up a new synology and might move some of the stuff that's running on this machine over to there. I guess for now I will close this one, and if it starts happening again, I will try on the newest version and get back to you.

More freezes today . I think it's worth noting a few observations and thoughts I've had.

While hass is completely frozen even for connections not coming via nabu casa, other services on the host such as portainer and deluge are having no problem serving up their UI.. There's about 70k of memory left on the host which isn't much, but they still function.
My ISP had notified us of similar attacks in the past but I noticed no issues with my hass ui using SSL.. I do suspect the cloud component of dealing poorly with low bandwidth situations which may lead to it freezing.

I think there can be 2 issues:

Most of the components don't deal with a network issue. Depend on the hardware, you have a thread pool of 8-16 threads, and network pools can eat them. That means any entity update need a thread. Is typically that no problem because they need 0.2 - 1 sec per update and over ~ 16 threads you don't notice any problem. If you have a network issue, a component can have a timeout of 5 - 15min and they kill the instance if they have no free thread.

The Remote UI has some cache for 20-40sec slow done of the connection. If the connection going to slow, it kills it and should be self-healing, but that need some time until they are sync again. I think around 10min. But yeah, Remote UI with ISP connection issue will not work very well.

Okay, that makes sense. I didn't realize that threads were in such limited supply. I stopped dropbox again and not long after, the ui returned (first time I've found such a direct cause-effect way to fix it).. So I suspect they are competing for resources, memory or network.. I am working on migrating the file serving functions off to another server which will free up a lot of resources and hopefully fix the problem.

It had been working well after I had moved some stuff off the machine, but today I am able to access from the local IP address only. The nabu casa URL gives me:
This site can’t provide a secure connection

q8h9lk0l7q45k29szxsv6vmyzrbdj07w.ui.nabu.casa sent an invalid response.
ERR_SSL_PROTOCOL_ERROR

when connecting from a browser
And a connection error with the following error when connecting from the app:
Shared.TokenManager.TokenError error 1
Local host and port are fine. All was working yesterday and there’s been no config changes other than some Lovelace changes.

Go in the UI to configuration -> cloud and make sure that remote connection is enabled and available.

Guys, I'm reopening this, as it happened again today, and I'm 100% sure there are no network issues now. Speedtest is showing 50mbit down and 10 mbit up, the server is reachable and the logs and all other components are running.. It's only the UI that isn't responsive, and I'm getting the errors below:
2019-05-15 23:05:47 INFO (MainThread) [homeassistant.components.http.view] Serving /api/websocket to <IP_ADDRESS> (auth: False)
2019-05-15 23:05:47 DEBUG (SyncWorker_5) [botocore.credentials] Looking for credentials via: ec2-credentials-file
2019-05-15 23:05:47 DEBUG (Dummy-5) [libopenzwave] notif_callback : new notification
2019-05-15 23:05:47 DEBUG (MainThread) [homeassistant.components.sensor.airvisual] New data retrieved: {'city': 'Prague', 'state': 'Praha', 'country': 'Czech Republic', 'location': {'type': 'Point', 'coordinates': [14.411826111111111, 50.042003611111106]}, 'current': {'weather': {'ts': '2019-05-15T20:00:00.000Z', 'hu': 93, 'ic': '10n', 'pr': 1020, 'tp': 6, 'wd': 350, 'ws': 4.6}, 'pollution': {'ts': '2019-05-15T19:00:00.000Z', 'aqius': 17, 'mainus': 'o3', 'aqicn': 14, 'maincn': 'o3'}}}
2019-05-15 23:05:47 DEBUG (SyncWorker_5) [botocore.credentials] Looking for credentials via: boto-config
2019-05-15 23:05:47 DEBUG (Dummy-5) [libopenzwave] notif_callback : Notification type : 2, nodeId : 6
2019-05-15 23:05:48 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event state_changed[L]: entity_id=zwave.aeotec_zw096_smart_switch_6, old_state=<state zwave.aeotec_zw096_smart_switch_6=ready; node_id=6, node_name=Aeotec ZW096 Smart Switch 6, manufacturer_name=Aeotec, product_name=ZW096 Smart Switch 6, query_stage=Complete, is_awake=True, is_ready=True, is_failed=False, is_info_received=True, max_baud_rate=40000, is_zwave_plus=True, capabilities={'beaming', 'listening', 'routing', 'zwave_plus'}, neighbors={1}, sentCnt=38, sentFailed=0, retries=2, receivedCnt=7059, receivedDups=86, receivedUnsolicited=7014, sentTS=2019-05-15 16:35:21:869 , receivedTS=2019-05-15 23:05:16:660 , lastRequestRTT=97, averageRequestRTT=68, lastResponseRTT=111, averageResponseRTT=75, friendly_name=Aeotec ZW096 Smart Switch 6 @ 2019-05-15T12:22:38.421331+02:00>, new_state=<state zwave.aeotec_zw096_smart_switch_6=ready; node_id=6, node_name=Aeotec ZW096 Smart Switch 6, manufacturer_name=Aeotec, product_name=ZW096 Smart Switch 6, query_stage=Complete, is_awake=True, is_ready=True, is_failed=False, is_info_received=True, max_baud_rate=40000, is_zwave_plus=True, capabilities={'beaming', 'listening', 'routing', 'zwave_plus'}, neighbors={1}, sentCnt=38, sentFailed=0, retries=2, receivedCnt=7061, receivedDups=86, receivedUnsolicited=7016, sentTS=2019-05-15 16:35:21:869 , receivedTS=2019-05-15 23:05:35:599 , lastRequestRTT=97, averageRequestRTT=68, lastResponseRTT=111, averageResponseRTT=75, friendly_name=Aeotec ZW096 Smart Switch 6 @ 2019-05-15T12:22:38.421331+02:00>>
2019-05-15 23:05:49 DEBUG (SyncWorker_5) [botocore.credentials] Looking for credentials via: container-role
2019-05-15 23:05:49 DEBUG (Dummy-5) [libopenzwave] addValueId : ValueID :<PHONE_NUMBER>3605248
2019-05-15 23:05:49 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event state_changed[L]: entity_id=switch.aeotec_zw096_smart_switch_6_switch, old_state=<state switch.aeotec_zw096_smart_switch_6_switch=on; node_id=6, value_index=0, value_instance=1, value_id=72057594143391744, power_consumption=0.0, friendly_name=Aeotec ZW096 Smart Switch 6 Switch @ 2019-05-15T12:21:28.700381+02:00>, new_state=<state switch.aeotec_zw096_smart_switch_6_switch=on; node_id=6, value_index=0, value_instance=1, value_id=72057594143391744, power_consumption=1.142, friendly_name=Aeotec ZW096 Smart Switch 6 Switch @ 2019-05-15T12:21:28.700381+02:00>>
2019-05-15 23:05:49 DEBUG (SyncWorker_5) [botocore.credentials] Looking for credentials via: iam-role
2019-05-15 23:05:49 DEBUG (Dummy-5) [libopenzwave] addValueId : GetCommandClassId : 50, GetType : 0
2019-05-15 23:05:49 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event state_changed[L]: entity_id=sensor.aeotec_zw096_smart_switch_6_energy, old_state=<state sensor.aeotec_zw096_smart_switch_6_energy=116.8; node_id=6, value_index=0, value_instance=1, value_id=72057594143604738, power_consumption=0.0, unit_of_measurement=kWh, friendly_name=Miele Washer Energy, icon=mdi:washing-machine @ 2019-05-15T23:05:07.362604+02:00>, new_state=<state sensor.aeotec_zw096_smart_switch_6_energy=116.8; node_id=6, value_index=0, value_instance=1, value_id=72057594143604738, power_consumption=1.142, unit_of_measurement=kWh, friendly_name=Miele Washer Energy, icon=mdi:washing-machine @ 2019-05-15T23:05:49.943537+02:00>>
2019-05-15 23:05:50 DEBUG (Thread-3) [sseclient] Dispatching keep-alive event, 4 bytes...
2019-05-15 23:05:50 INFO (SyncWorker_5) [botocore.vendored.requests.packages.urllib3.connectionpool] Starting new HTTP connection (1): <IP_ADDRESS>
2019-05-15 23:05:50 DEBUG (Dummy-5) [libopenzwave] addValueId : Notification : {'notificationType': 'ValueChanged', 'homeId':<PHONE_NUMBER>, 'nodeId': 6, 'valueId': {'homeId':<PHONE_NUMBER>, 'nodeId': 6, 'commandClass': 'COMMAND_CLASS_METER', 'instance': 1, 'index': 32, 'id':<PHONE_NUMBER>3605248, 'genre': 'User', 'type': 'Bool', 'value': False, 'label': 'Exporting', 'units': '', 'readOnly': True}}
2019-05-15 23:05:51 DEBUG (Dummy-5) [libopenzwave] notif_callback : call callback context
2019-05-15 23:05:51 DEBUG (Thread-3) [nest.nest] <<< keep-alive event
2019-05-15 23:05:51 DEBUG (Dummy-5) [openzwave] zwcallback args=[{'notificationType': 'ValueChanged', 'homeId':<PHONE_NUMBER>, 'nodeId': 6, 'valueId': {'homeId':<PHONE_NUMBER>, 'nodeId': 6, 'commandClass': 'COMMAND_CLASS_METER', 'instance': 1, 'index': 32, 'id':<PHONE_NUMBER>3605248, 'genre': 'User', 'type': 'Bool', 'value': False, 'label': 'Exporting', 'units': '', 'readOnly': True}}]
2019-05-15 23:05:51 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event state_changed[L]: entity_id=sensor.aeotec_zw096_smart_switch_6_previous_reading, old_state=<state sensor.aeotec_zw096_smart_switch_6_previous_reading=115.86; node_id=6, value_index=1, value_instance=1, value_id=72057594143604754, power_consumption=0.0, unit_of_measurement=kWh, friendly_name=Aeotec ZW096 Smart Switch 6 Previous Reading @ 2019-05-15T23:05:08.414864+02:00>, new_state=<state sensor.aeotec_zw096_smart_switch_6_previous_reading=115.86; node_id=6, value_index=1, value_instance=1, value_id=72057594143604754, power_consumption=1.142, unit_of_measurement=kWh, friendly_name=Aeotec ZW096 Smart Switch 6 Previous Reading @ 2019-05-15T23:05:51.049385+02:00>>
2019-05-15 23:05:51 DEBUG (SyncWorker_5) [botocore.utils] Caught exception while trying to retrieve credentials: ('Connection aborted.', OSError(101, 'Network unreachable'))
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 544, in urlopen
    body=body, headers=headers)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 349, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 130, in _send_request
    self, method, url, body, headers, *args, **kwargs)
  File "/usr/local/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 157, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 242, in send
    return HTTPConnection.send(self, str)
  File "/usr/local/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connection.py", line 155, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connection.py", line 134, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/connection.py", line 88, in create_connection
    raise err
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/connection.py", line 78, in create_connection
    sock.connect(sa)
OSError: [Errno 101] Network unreachable

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/adapters.py", line 370, in send
    timeout=timeout
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 597, in urlopen
    _stacktrace=sys.exc_info()[2])
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/retry.py", line 245, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/packages/six.py", line 309, in reraise
    raise value.with_traceback(tb)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 544, in urlopen
    body=body, headers=headers)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connectionpool.py", line 349, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/local/lib/python3.7/http/client.py", line 1229, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 130, in _send_request
    self, method, url, body, headers, *args, **kwargs)
  File "/usr/local/lib/python3.7/http/client.py", line 1275, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.7/http/client.py", line 1224, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 157, in _send_output
    self.send(msg)
  File "/usr/local/lib/python3.7/site-packages/botocore/awsrequest.py", line 242, in send
    return HTTPConnection.send(self, str)
  File "/usr/local/lib/python3.7/http/client.py", line 956, in send
    self.connect()
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connection.py", line 155, in connect
    conn = self._new_conn()
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/connection.py", line 134, in _new_conn
    (self.host, self.port), self.timeout, **extra_kw)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/connection.py", line 88, in create_connection
    raise err
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/packages/urllib3/util/connection.py", line 78, in create_connection
    sock.connect(sa)
botocore.vendored.requests.packages.urllib3.exceptions.ProtocolError: ('Connection aborted.', OSError(101, 'Network unreachable'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/site-packages/botocore/utils.py", line 174, in _get_request
    response = requests.get(url, timeout=timeout)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/api.py", line 69, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/api.py", line 50, in request
    response = session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/sessions.py", line 465, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/sessions.py", line 573, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/botocore/vendored/requests/adapters.py", line 415, in send
    raise ConnectionError(err, request=request)
botocore.vendored.requests.exceptions.ConnectionError: ('Connection aborted.', OSError(101, 'Network unreachable'))

You know what, it might be a memory issue as I've only got 76k free and python seems to be really going crazy on resources.. I started a check config and everything completely froze up right after..


Packit didn't detect a built Copr rpm

This is a bug report told mostly through screenshots, sorry :)
On the PR https://github.com/oamg/convert2rhel/pull/469 the Packit jobs for creating Copr builds started. Two and half hours later, the jobs are still incomplete even though it took mere 7 minutes to build the Copr rpms. Packit hasn't detected that.

https://github.com/oamg/convert2rhel/pull/469/checks?check_run_id=9146708400

https://dashboard.packit.dev/results/srpm-builds/95258

https://copr.fedorainfracloud.org/coprs/g/oamg/convert2rhel/build/4994067/

hi, thank you for creating an issue! Just to be sure, this happened only once on the given PR? If we lost the message from Copr, there should be still a babysitting job that would update the status, so it looks something went wrong, I will take a closer look at this.

I haven't found the reason why the message from fedmsg was not originally processed, but I found out that we need to fix our babysitting task to handle builds in waiting_for_srpm state properly (currently, it handles only pending builds), see:
2022-10-27T16:56:26.585+0000 | Getting copr build ID 4994067 from DB.
2022-10-27T16:56:27.008+0000 | The status is 'succeeded'.
2022-10-27T16:56:27.009+0000 | DB state says <BuildStatus.waiting_for_srpm: 'waiting_for_srpm'>, things were taken care of already, skipping.
2022-10-27T16:56:27.009+0000 | DB state says <BuildStatus.waiting_for_srpm: 'waiting_for_srpm'>, things were taken care of already, skipping.
2022-10-27T16:56:27.009+0000 | DB state says <BuildStatus.waiting_for_srpm: 'waiting_for_srpm'>, things were taken care of already, skipping.

TODO:

[ ] update the method that should update the Copr builds:

[ ] do not skip builds in waiting_for_srpm state
[ ] currently, we check only ended_on field from the Copr API and run the CoprBuildEndHandler if it is not None, but in case the last state in our DB is waiting_for_srpm, we could check started_on (if ended_on is None) and update both SRPMBuildModel and CoprBuildTargetModels via running CoprBuildStartHandler if started_on is not None


npsp:Too many query rows: 50001

We are doing bulk donation upload for contacts using CSV file upload from a VF page. When contacts in CSV go beyond 180, we get this error: npsp:Too
Logs.txt
many query rows: 50001
Currently there are lot of donations records against every contact in production and hence the package is throwing this error as some where the query is not filtered. Can you please help us by analyzing the log file attached below.
Also below are few lines from debug logs:
19:33:11.723<PHONE_NUMBER>1)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>9)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>5)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>5)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>6)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>6)|SOQL_EXECUTE_BEGIN|[222]|Aggregations:0|select id from FiscalYearSettings  where IsStandardYear = false
19:33:11.723<PHONE_NUMBER>1)|SOQL_EXECUTE_END|[222]|Rows:0
19:33:11.723<PHONE_NUMBER>6)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>2)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>6)|ENTERING_MANAGED_PKG|npsp
19:33:11.723<PHONE_NUMBER>9)|SOQL_EXECUTE_BEGIN|[449]|Aggregations:0|SELECT ContactId, Fiscal_Year(Opportunity.CloseDate) CalendarYr, SUM(Opportunity.Amount) TotalOppAmount, AVG(Opportunity.Amount) AverageAmount, MIN(Opportunity.Amount) SmallestAmount, MAX(Opportunity.Amount) LargestAmount, MIN(Opportunity.CloseDate) FirstCloseDate, MAX(Opportunity.CloseDate) LastCloseDate, COUNT_DISTINCT(Opportunity.Id) NumberOfClosedOpps, MAX(Opportunity.npo02__CombinedRollupFieldset__c) RollupFieldset FROM OpportunityContactRole WHERE isPrimary=true AND Opportunity.isWon=true AND Opportunity.Amount != null AND Opportunity.RecordTypeId NOT IN :rectypeset AND Opportunity.Type NOT IN :typeset AND ContactId IN :cset GROUP BY ROLLUP(ContactId, Fiscal_Year(Opportunity.CloseDate))
19:33:15.212<PHONE_NUMBER>4)|SOQL_EXECUTE_END|[449]|Rows:1363
19:33:15.212<PHONE_NUMBER>7)|CUMULATIVE_LIMIT_USAGE
19:33:15.212<PHONE_NUMBER>7)|LIMIT_USAGE_FOR_NS|(default)|
Number of SOQL queries: 43 out of 200
Number of query rows: 2114 out of 50000
Number of SOSL queries: 0 out of 20
Number of DML statements: 10 out of 150
Number of DML rows: 1459 out of 10000
Maximum CPU time: 20512 out of 60000
Maximum heap size: 0 out of 12000000
Number of callouts: 0 out of 0
Number of Email Invocations: 0 out of 10
Number of future calls: 0 out of 0
Number of queueable jobs added to the queue: 0 out of 1
Number of Mobile Apex push calls: 0 out of 10
19:33:15.212<PHONE_NUMBER>7)|LIMIT_USAGE_FOR_NS|MC4SF|
Number of SOQL queries: 3 out of 200
Number of query rows: 0 out of 50000
Number of SOSL queries: 0 out of 20
Number of DML statements: 1 out of 150
Number of DML rows: 25 out of 10000
Maximum CPU time: 0 out of 60000
Maximum heap size: 0 out of 12000000
Number of callouts: 0 out of 0
Number of Email Invocations: 0 out of 10
Number of future calls: 0 out of 0
Number of queueable jobs added to the queue: 0 out of 1
Number of Mobile Apex push calls: 0 out of 10
19:33:15.212<PHONE_NUMBER>7)|LIMIT_USAGE_FOR_NS|npsp|
Number of SOQL queries: 47 out of 200
Number of query rows: 58547 out of 50000 ******* CLOSE TO LIMIT
Number of SOSL queries: 0 out of 20
Number of DML statements: 61 out of 150
Number of DML rows: 1159 out of 10000
Maximum CPU time: 0 out of 60000
Maximum heap size: 0 out of 12000000
Number of callouts: 0 out of 0
Number of Email Invocations: 0 out of 10
Number of future calls: 0 out of 0
Number of queueable jobs added to the queue: 0 out of 1
Number of Mobile Apex push calls: 0 out of 10
19:33:15.212<PHONE_NUMBER>7)|LIMIT_USAGE_FOR_NS|SurveyMonkey|
Number of SOQL queries: 13 out of 200
Number of query rows: 607 out of 50000
Number of SOSL queries: 0 out of 20
Number of DML statements: 0 out of 150
Number of DML rows: 0 out of 10000
Maximum CPU time: 0 out of 60000
Maximum heap size: 0 out of 12000000
Number of callouts: 0 out of 0
Number of Email Invocations: 0 out of 10
Number of future calls: 0 out of 0
Number of queueable jobs added to the queue: 0 out of 1
Number of Mobile Apex push calls: 0 out of 10
19:33:15.212<PHONE_NUMBER>7)|CUMULATIVE_LIMIT_USAGE_END
19:33:15.537<PHONE_NUMBER>2)|DML_END|[510]
19:33:15.537<PHONE_NUMBER>3)|FATAL_ERROR|System.LimitException: npsp:Too many query rows: 50001
(npsp)

That's the donation aggregation function running - it has to aggregate donor stats for all hard and soft credits associated with the donation.  Generally speaking, when importing donations we recommend reducing batch size or deferring your calculations until all donations are added, then running the batch update job.

@kbromer Thank you very much for your help. By reducing batch size do you suggest we reduce the Rollup Batch Size in NPSP settings? This is currently set as 200.

Correct


Add channels, env and prettier

Issue #1389

It seems you accepted twice the suggestion 🤯. Please, remove the repeated sentence at the end.

Yeah I saw that.
I'm trying to remove it but the master branch has changed...

Thanks for the help !


Switch from home-grown SSDP to SSDP gem for discovery

Seems to work a lot more consistently, at least for me. Looking for some additional spot-testing, but the code's a lot more simple on our end as a result.

Cool


Added Debian sid (#3)

root@docker-builder-6:~/image-debian/sid# make image_on_store
test -f /tmp/create-image-from-http.sh \
        || wget -qO /tmp/create-image-from-http.sh https://github.com/scaleway/scaleway-cli/raw/master/examples/create-image-from-http.sh
chmod +x /tmp/create-image-from-http.sh
rsync -Pave ssh /tmp/build/scw-distrib-debian-sid/rootfs.tar store.scw.42.am:store/scw/scw-distrib-debian-sid.tar
Enter passphrase for key '/root/.ssh/id_rsa':
sending incremental file list

sent 50 bytes  received 12 bytes  17.71 bytes/sec
total size is 660,449,280  speedup is 10,652,407.74
http://store.scw.42.am/scw/scw-distrib-debian-sid.tar
VOLUME_SIZE="50G" IMAGE_NAME="Debian Sid/Unstable" IMAGE_BOOTSCRIPT="latest" /tmp/create-image-from-http.sh http://store.scw.42.am/scw/scw-distrib-debian-sid.tar
[+] URL of the tarball: http://store.scw.42.am/scw/scw-distrib-debian-sid.tar
[+] Target name: scw-distrib-debian-sid.tar
[+] Creating new server in rescue mode with a secondary volume...
/tmp/create-image-from-http.sh: line 29: scw: command not found
../docker-rules.mk:101: recipe for target 'image_on_store' failed
make: *** [image_on_store] Error 127
root@docker-builder-6:~/image-debian/sid# ^C
root@docker-builder-6:~/image-debian/sid# ^C
root@docker-builder-6:~/image-debian/sid# clear; make image_on_store
test -f /tmp/create-image-from-http.sh \
        || wget -qO /tmp/create-image-from-http.sh https://github.com/scaleway/scaleway-cli/raw/master/examples/create-image-from-http.sh
chmod +x /tmp/create-image-from-http.sh
rsync -Pave ssh /tmp/build/scw-distrib-debian-sid/rootfs.tar store.scw.42.am:store/scw/scw-distrib-debian-sid.tar
Enter passphrase for key '/root/.ssh/id_rsa':
sending incremental file list

sent 50 bytes  received 12 bytes  24.80 bytes/sec
total size is 660,449,280  speedup is 10,652,407.74
http://store.scw.42.am/scw/scw-distrib-debian-sid.tar
VOLUME_SIZE="50G" IMAGE_NAME="Debian Sid/Unstable" IMAGE_BOOTSCRIPT="latest" /tmp/create-image-from-http.sh http://store.scw.42.am/scw/scw-distrib-debian-sid.tar
[+] URL of the tarball: http://store.scw.42.am/scw/scw-distrib-debian-sid.tar
[+] Target name: scw-distrib-debian-sid.tar
[+] Creating new server in rescue mode with a secondary volume...
[+] Server created: 00000000-0000-1000-0000-000000000000
[+] Booting...
Enter passphrase for key '/root/.ssh/id_rsa':
Linux image-writer-scw-distrib-debian-sid-tar 3.2.34-30 #17 SMP Mon Apr 13 15:53:45 UTC 2015 armv7l armv7l armv7l GNU/Linux
[+] Server is booted
[+] Formating and mounting /dev/nbd1...
Enter passphrase for key '/root/.ssh/id_rsa':
mke2fs 1.42.9 (4-Feb-2014)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
Stride=0 blocks, Stripe width=0 blocks
3055616 inodes, 12207031 blocks
610351 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=0
373 block groups
32768 blocks per group, 32768 fragments per group
8192 inodes per group
Superblock backups stored on blocks:
        32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
        4096000, 7962624, 11239424

Allocating group tables: done
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

[+] /dev/nbd1 formatted in ext4 and mounted on /mnt
[+] Download tarball from S3 and write it to /dev/nbd1
Enter passphrase for key '/root/.ssh/id_rsa':
Enter passphrase for key '/root/.ssh/id_rsa':
[+] Tarball extracted on /dev/nbd1
[+] Stopping the server
[+] Server stopped
[+] Creating a snapshot of nbd1
[+] Snapshot 11111111-1111-1111-1111-111111111111 created
[+] Creating an image based of the snapshot
[+] Image created: 22222222-2222-1222-2222-222222222222
[+] Deleting temporary server
[+] Server deleted

$ scw inspect 00000000-0000-1000-0000-000000000000

[{
  "id": "00000000-0000-1000-0000-000000000000",
  "name": "Debian Sid/Unstable",
  "creation_date": "2015-09-11T11:30:41.842288+00:00",
  "modification_date": "2015-09-11T11:30:41.842288+00:00",
  "root_volume": {
    "id": "11111111-1111-1111-1111-111111111111",
    "size":<PHONE_NUMBER>0,
    "name": "scw-distrib-debian-sid-2015-09-11_11:26",
    "volume_type": "l_ssd"
  },
  "default_bootscript": {
    "id": "22222222-2222-1222-2222-222222222222",
    "title": "4.1.6-std #249 (latest)",
    "bootcmdargs": {
      "id": "33333333-3333-1333-3333-333333333333",
      "value": "LINUX_COMMON ip=dhcp boot=local root=/dev/nbd0 nbd.max_parts=8"
    },
    "initrd": {
      "id": "44444444-4444-1444-4444-444444444444",
      "path": "initrd/c1-uInitrd-v3.3",
      "title": "C1 uInitrd v3.3"
    },
    "kernel": {
      "id": "55555555-5555-1555-5555-555555555555",
      "dtb": "dtb/pimouss-computing.dtb.4.1.6-249-std",
      "path": "kernel/pimouss-uImage-4.1.6-249-std",
      "title": "Pimouss 4.1.6-249-std"
    },
    "public": true
  },
  "organization": "66666666-6666-1666-6666-666666666666",
  "arch": "arm"
}]

Welcome to Scaleway' initrd            http://j.mp/scw-initrd-linux

███████╗ ██████╗ █████╗ ██╗     ███████╗██╗    ██╗ █████╗ ██╗   ██╗
██╔════╝██╔════╝██╔══██╗██║     ██╔════╝██║    ██║██╔══██╗╚██╗ ██╔╝
███████╗██║     ███████║██║     █████╗  ██║ █╗ ██║███████║ ╚████╔╝
╚════██║██║     ██╔══██║██║     ██╔══╝  ██║███╗██║██╔══██║  ╚██╔╝
███████║╚██████╗██║  ██║███████╗███████╗╚███╔███╔╝██║  ██║   ██║
╚══════╝ ╚═════╝╚═╝  ╚═╝╚══════╝╚══════╝ ╚══╝╚══╝ ╚═╝  ╚═╝   ╚═╝

>>> Initrd build: v3.3.0-0-g6c531b5 - 2015/09/07
>>> Kernel version: 4.1.6-249

>>> Installing busybox...
>>> Cloning initramfs for shutdown......
>>> Mounting pseudo-filesystems......
>>> Mounting /dev...
>>> Mounting /dev/pts...
>>> Mounting /run...
>>> Mounting /sys...
>>> Mounting /proc...

>>> Kernel cmdline: earlyprintk=ttyS0 console=ttyS0,9600n8 nousb noplymouth ip=dhcp boot=local root=/dev/nbd0 nbd.max_parts=8

>>> Configuring GPIOs...
>>> Configuring network...

>>> Server ID: 3dcf2da8-9afb-40f9-af51-979cfe68039e
>>> Private IP: <IP_ADDRESS>
>>> Public IP: <IP_ADDRESS>
>>> Hostname: serene-blackwell

>>> Checking user input for debug/verbose mode...
>>> Checking user input for debug shell...
>>> Signaling the server is kernel-started to the control plane...
>>> Adjusting time (ntp)...
>>> Initializing 'local' root file system...
>>> Attaching nbd0...
>>> Mounting nbd0 root...
>>> Mounting /newroot...
>>> Checking metadata in case we skip to wait for secondary volumes to be ready...
>>> Signaling the server is booted to the control plane...
>>> Creating default configuration files on rootfs......
>>> Checking metadata for debug shell...
>>> Checking metadata for debug sshd (dropbear)...
>>> Changing root password...
>>> Mounting /newroot/proc...
>>> Mounting /newroot/sys...
>>> Mounting /newroot/run...
>>> Mounting /newroot/dev...
>>> Moving initramfs backup to /run/initramfs for shutdown...
>>> Switching to linux...

[  OK  ] Created slice User and Session Slice.
[  OK  ] Reached target Encrypted Volumes.
[  OK  ] Reached target Remote File Systems (Pre).
[  OK  ] Reached target Swap.
[  OK  ] Created slice System Slice.
[  OK  ] Created slice system-serial\x2dgetty.slice.
[  OK  ] Listening on Journal Socket (/dev/log).
[  OK  ] Started Forward Password Requests to Wall Directory Watch.
         Starting Increase datagram queue length...
[  OK  ] Listening on udev Control Socket.
[  OK  ] Created slice system-getty.slice.
[  OK  ] Started Dispatch Password Requests to Console Directory Watch.
[  OK  ] Reached target Paths.
[  OK  ] Reached target Network is Online.
[  OK  ] Reached target Slices.
[  OK  ] Listening on Journal Socket.
         Starting Load Kernel Modules...
         Starting Create Static Device Nodes in /dev...
         Mounting POSIX Message Queue File System...
         Starting Remount Root and Kernel File Systems...
         Starting SCW kernel requirements checker...
         Mounting Debug File System...
[  OK  ] Listening on udev Kernel Socket.
[  OK  ] Listening on /dev/initctl Compatibility Named Pipe.
[UNSUPP] Starting of Arbitrary Executable Fi...m Automount Point not supported.
[  OK  ] Mounted POSIX Message Queue File System.
[  OK  ] Started Load Kernel Modules.
[  OK  ] Started Remount Root and Kernel File Systems.
[  OK  ] Mounted Debug File System.
[  OK  ] Started Create Static Device Nodes in /dev.
[  OK  ] Started Increase datagram queue length.
[  OK  ] Started SCW kernel requirements checker.
[  OK  ] Listening on Syslog Socket.
         Starting Journal Service...
         Starting udev Kernel Device Manager...
[  OK  ] Reached target Local File Systems (Pre).
         Starting Load/Save Random Seed...
[  OK  ] Reached target Local File Systems.
[  OK  ] Reached target Remote File Systems.
         Starting udev Coldplug all Devices...
         Starting Apply Kernel Variables...
[  OK  ] Started Load/Save Random Seed.
[  OK  ] Started Apply Kernel Variables.
[  OK  ] Started Journal Service.
         Starting Flush Journal to Persistent Storage...
[  OK  ] Started Flush Journal to Persistent Storage.
[  OK  ] Started udev Kernel Device Manager.
         Starting Create Volatile Files and Directories...
[  OK  ] Started Create Volatile Files and Directories.
         Starting Update UTMP about System Boot/Shutdown...
[  OK  ] Reached target System Time Synchronized.
[  OK  ]
Debian GNU/Linux stretch/sid serene-blackwell ttyS0

serene-blackwell login:

Only 1 warning for the boot

$ scw run f78f4a1b-7fd3-4ad3-b392-dd45aee4854e

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
-bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
-bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
root@desperate-chandrasekhar:~#

update-motd.t not working
problem with locales

root@desperate-chandrasekhar:~# lsb_release -a
No LSB modules are available.
 Done
root@desperate-chandrasekhar:~# apt-get upgrade
Reading package lists... Done
Building dependency tree
Reading state information... Done
Calculating upgrade... Done
The following packages will be upgraded:
  sysstat
1 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Need to get 293 kB of archives.
After this operation, 1024 B of additional disk space will be used.
Do you want to continue? [Y/n]
Get:1 http://ftp.fr.debian.org/debian/ sid/main sysstat armhf 11.1.6-2 [293 kB]
Fetched 293 kB in 0s (4109 kB/s)
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
        LANGUAGE = (unset),
        LC_ALL = "en_US.UTF-8",
        LC_CTYPE = "UTF-8",
        LANG = "en_US.UTF-8"
    are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
debconf: delaying package configuration, since apt-utils is not installed
(Reading database ... 26746 files and directories currently installed.)
Preparing to unpack .../sysstat_11.1.6-2_armhf.deb ...
Unpacking sysstat (11.1.6-2) over (11.1.6-1) ...
Processing triggers for systemd (226-1) ...
Processing triggers for man-db (2.7.3-1) ...
Setting up sysstat (11.1.6-2) ...
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
root@desperate-chandrasekhar:~#

apt-get update && apt-get upgrade: OK

Reboot: OK

Locale fixed, but still no dynamic motd
Not blocking for a first release

LGTM

LGTM

LGTM


New control [EnhancedThemeProvider]

Category
[X] Enhancement
[ ] Bug
[ ] Question
Version
Please specify what version of the library you are using: [3.7.2]
Expected / Desired Behavior / Question
Improved support for themes and fonts when creating Tab or Personal App in SPFx for Teams or creating Isolated Web Parts
Observed Behavior
As specified by issue #1130, the use of Fluent UI React in the version currently used with SPFx 1.14 and earlier, brings with it problems with Teams, and specifically with the High Contrast Theme.
Specifically, if you create a Web Part to be used as a Teams Tab, or as a Personal App, there are two problems:

Themes provided by the SharePoint page that do not reflect the real Microsoft Teams themes (especially the High Contrast one)
Lack of default font (Segoe family) when not using Fluent UI React controls.

These two issues frustrate both developers who must write code to implement default font support every time, and users who want to use Web Parts with a dark or high-contrast theme.
I also experienced the problem of fonts when making isolated Web Parts.
Steps to Reproduce
Same scenario discussed in issue #1130
Solution
I'm working on creating a control that handles these things:

Automatic add of correct fonts
Better support for Teams themes by recreating them in Fluent UI React (Teams supports Fluent UI NorthStar themes)
Automatisms for automatic check of the Teams theme and use of the corresponding theme.

I will be creating the first PR for this control shortly,
Thanks!

Hi all,
just to inform that I'm finished the EnhancedThemeProvider control (PR will be available ASAP) that fix the mail problem mention on this issue.
I reimplemented the Hight Contrast Theme (not for all controls, it's a huge work to do that) and the result is this:

@fabiofranzini  👏👏👏👏👏


Invoice GL Posting Date

Hello,
We ran into a issue when posting invoice using the SDK.
The problem is that the invoice's GL posting date is not populating in our client's Intacct instance even though the glPostingDate is set explicitlym our code using the following code snippet:
...
$billCreate = new BillCreate();
$billCreate->setGlPostingDate(self::getDateType($export->getPostMonth()));
...

The strange thing is that this works perfectly fine on our dev Intacct instance, but it does not work on our client's Intacct instance.
Unfortunately we are stuck version 1.0.7 of the sdk because the application is running in PHP 5.6, and upgrading to PHP 7 is not going happen any time soon. This means the BillCreate here is using the legacy BillCreate.
Any insights into why this is happening would be greatly appreciated.
Thanks.

I would double check your client's company has allow GL posting date overrides on the bill enabled.
I'm also curious what your code self::getDateType($export->getPostMonth()) evaluates to.  Are you able to use xdebug to look at this, or write it to a log file?  The SDK has monolog support built-in so you can log the XML request, an example is in one of the tests here - https://github.com/Intacct/intacct-sdk-php/blob/1.0/test/Intacct/IntacctClientTest.php#L318

Hi Jimmy,
I was able to verify that their Overriding GL Posting date setting is turned on.

self::getDateType would take a PHP DateTime and return an instance of DateType for Intacct.
For logging ,we've only added logging for Intacct SDK recently, so maybe when I have more logs, it will be easier to debug.
Could you think of another settings that would affect this ? This functionality works on our dev Intacct instance, but not on the client's Intacct which leads us to believe there might be a setting somewhere that's preventing setting the GL posting date.
Regards,
Tom

Could you think of another settings that would affect this ? This functionality works on our dev Intacct instance, but not on the client's Intacct which leads us to believe there might be a setting somewhere that's preventing setting the GL posting date.

You would normally get an API error message back if some config was preventing it.  I think you're going to have to log the request/response to really verify this.

Hi Jimmy,
It turned out to be a setting on our software that was preventing sending the post date.
Thank you for your help!
Tom


Update index.md

For a newbie following the tutorial

Mentioned steps suggest how to use aptos in a fresh project.
But the example code is directly from examples package, which doesn't work in fresh project and might lead to confusion.
While running the code it shows error missing import path. Typo in import statement.
The optional imports of package bcs and crypto not working in fresh projects. Since they are not required in the mentioned tutorial, removing them. Reference :
go get github.com/aptos-labs/aptos-go-sdk/crypto       go: module github.com/aptos-labs/aptos-go-sdk@upgrade found (v0.1.0), but does not contain package github.com/aptos-labs/aptos-go-sdk/crypto go get github.com/aptos-labs/aptos-go-sdk/bcs    go: module github.com/aptos-labs/aptos-go-sdk@upgrade found (v0.1.0), but does not contain package github.com/aptos-labs/aptos-go-sdk/bcs

Thanks for your contribution!


fix setCaPath test failure

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

12 of 12 (100.0%)  changed or added relevant lines in 2 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage decreased (-0.01%) to 94.986%

Files with Coverage Reduction
New Missed Lines
%

join/network/include/join/socket.hpp
1
85.45%

Totals

Change from base Build<PHONE_NUMBER>:
-0.01%

Covered Lines:
5210

Relevant Lines:
5485

💛  - Coveralls


Incompatibility with PizzaTowerEscapeMusic when paired with FacilityMeltdown

Problem:
The meltdown escape music that is supposed to play when taking the apparatus fails to play when LateGameUpgrades is enabled.
Conversely, the default escape music (when the ship is about to leave) plays normally; it's only the apparatus music.
Strangely, when you go back in to get the apparatus when the ship is about to leave and the default escape music is already playing, only then will the music change to the meltdown escape music.
Steps:
To reproduce bug:
Start a new game with all mods enabled and loaded, land on a moon and enter the facility, then find the apparatus and take it. There should be some sound effects, but no music.
(Imperium is included in the modpack below, so you can teleport to the apparatus after and only after entering the facility so you don't get the outside audio being stuck while you are inside. What I did was teleport to the entrance, entered, and then teleported to the apparatus.)
Strange Workaround:
With all mods enabled and loaded, land on a moon and wait until around 10 pm (in game) when the default escape music starts playing. Then enter the facility, find the apparatus and take it. The meltdown escape music should start playing.
(Imperium is included in the modpack below, so you can speed up the time.)
The other obvious workaround would be disabling LateGameUpgrades. Leaving LateGameUpgrades' dependency, CSync, enabled, poses no issue.
Thunderstore Modpack code:
019283be-dc34-fe01-75a7-775633447c97
Modlist (With latest versions as of 10/12/2024):
Lordfirespeed-OdinSerializer-2022.11.9
BepInEx-BepInExPack-5.4.2100
Rune580-LethalCompany_InputUtils-0.7.7
xilophor-LethalNetworkAPI-3.3.1
giosuel-Imperium-0.2.7
BGN-PizzaTowerEscapeMusic-2.4.0
Evaisa-HookGenPatcher-0.0.5
Evaisa-LethalLib-0.16.1
loaforc-FacilityMeltdown-2.6.20
DiFFoZ-HarmonyXTranspilerFix-1.1.0
DiFFoZ-LethalPerformance-0.4.2
mattymatty-AsyncLoggers-2.1.2
AdiBTW-LoadstoneNightly-0.1.15
Evaisa-FixPluginTypesSerialization-1.1.1
WhiteSpike-Interactive_Terminal_API-1.2.0
Sigurd-CSync-5.0.1
malco-Lategame_Upgrades-3.10.4
Specific configuration changes (Everything else has default configs):
me.loaforc.facilitymeltdown.Client.cfg:
Music Volume is set to: 0
MusicPlaysOutside is set to: false
bgn.pizzatowerescapemusic.cfg:
Scripts is set to (case sensitive and no spaces between commas): Apparatus,Default
LogOutput:
LogOutput.log
My Guess:
FacilityMeltdown used to use CSync. LateGameUpgrades also uses CSync. Funny enough, when CSync is left enabled and LateGameUpgrades is disabled, the bug disappears. Nonetheless, I think that the problem might have something to do with CSync.

PROBLEM SOLVED:
Apparently when teleporting too quick with Imperium, the escape music does not play. If you find the Apparatus normally or walk around a bit after teleporting, the music plays.


[Feature Request]: For warning "This hop causes the target transform to receive rows with mixed layout!" please show either both rows or the difference

What would you like to happen?
For the warning HopRowException, "This hop causes the target transform to receive rows with mixed layout!" please show either the fields from both rows so that you can compare the rows or show the missing field(s). Currently, the same rows are shown so you don't know why it is a mixed layout and if you have 78 fields it is difficult to track it down.
Issue Priority
Priority: 3
Issue Component
Component: Hop Gui

We do show differences after the first difference in layout between two streams is found.
However, the current error dialog can be improved (made more visual) to help understand which fields are causing issues, especially on larger streams.

Are you saying, that the last hop connected, shows the differences (as in unique fields that don't match?) If so, yes, I did not realize that. Please update the message to say something like this perhaps?
The following fields are missing (do not match) compared to the other data row. The same number of fields must exist from both inputs...

I just did a quick test with 100 fields and changed a few things.
The differential algorithm stops at the first error:
HopRowException:  The data type of field #57 is not the same as the first row received: you're mixing rows with different layout. Field [field057 String] does not have the same data type as field [field057 Integer].
So a first realization is that we want to see all the differences.
How do we want to show the differences?  What would be the desired outcome?

I think ideally the error would show at least the first 3 differences. I think the below is pretty clear with each field on a separate line. for example:
`Data types and column counts must be equivalent for both data rows. Showing the first three differences found:

String field # 57 (MyFieldA) does not match Integer field # 57 (betterField)
String field # 58 (MyFieldB) does not match Integer field # 58 (bestestField)
...


Multi-stage Quarkus GraalVM builds do not produce runnable images

Following the Quarkus building a native image instructions with the getting-started from the quickstarts using the multi-stage Dockerfile creates an unusable image.
Running the resultant image produces the following error:
user$ docker run -i --rm -p 8080:8080 quarkus-hello-world
docker: Error response from daemon: OCI runtime create failed: container_linux.go:370: starting container process caused: exec: "./application": permission denied: unknown.

Full build log attached
quarkus-native-image-build-imagebuilder.log

Looks like the issue is with the line:
COPY --from=build /usr/src/app/target/*-runner /work/application

It puts *-runner into a directory called application, rather than moving *-runner to the file application. We need support for both Docker and imagebuilder so had to implement the following workaround:
Create a script to move the item in the directory to the directory location (if it's a directory):
#!/bin/bash

# This file is required due to differences between how openshift imagebuilder treats docker multistage files, and how native docker acts
# Consider the following line:
# COPY --from=build /usr/src/app/target/*-runner /work/application
#
# Native docker will create a single executable called "application" in the work directory
# Imagebuilder will take the approach of creating an application directory underneath work, and putting *-runner into that directory
#
# We need both approaches to work, so we need to work out if "application" is a directory, if it is then we need to take the first
# (and hopefully only) file in there and call it "application"

if [ -d /work/application ]; then
  mv /work/application /work/applicationdir
  mv /work/applicationdir/*-runner /work/application
fi

Then run it in the dockerfile:
COPY deploy/scripts/move.sh /work
RUN chmod 775 /work/move.sh
RUN /work/move.sh

/lifecycle frozen


Sync eng/common directory with azure-sdk-tools for PR 1551

Sync eng/common directory with azure-sdk-tools for PR https://github.com/Azure/azure-sdk-tools/pull/1551  See eng/common workflow

/check-enforcer override


Engine -> Flutter roll failed after taking 44 minutes to install XCode

The roll here https://github.com/flutter/flutter/pull/89334
failed on a presubmit check here
https://ci.chromium.org/ui/p/flutter/builders/try/Mac build_tests_1_4/9124/overview
on a timeout after it took 44 minutes to install XCode.
Marking P3 for now, but I will monitor for further failures.

Next roll attempt is here https://github.com/flutter/flutter/pull/89342

@zanderso Looks like the builds have been passing after this failure. Is this still an issue?

This is not currently happening as far as I can tell, but if we don't understand why it happened, then I am worried that it will happen again.

Marking as obsolete. I haven't seen this happening frequently only when the versions of xcode are updated.


Bump version of SixLabors ImageSharp

There are a couple of bugs related to https://github.com/SixLabors/ImageSharp/issues/1704 which I've been hitting running Statiq that surface on .Net 6. These look to have been resolved upstream, and attempting to run it locally with this change seems to be better.
Happy to raise an issue if that's a better way to discuss this, but I thought this was a light enough weight change.

v1.01 to 1.0.4 has no breaking changes documented
there's some test coverage of images working within Statiq, and ImageSharp has tests covering specifically this issue
there's a major version upgrade available as well, but that looked to need more changes/didn't feel like something I could do quickly/safely

Awesome- I agree that a major version bump, while probably a good idea, would require a little more work and validation. I'm happy to pull this smaller change in though - thanks!
Note that I won't be able to get a release with the changes out until early next week though (but will do so then).


remove useLayoutEffect dependency to open up to scroll to bottom on new message

First part of issue #827

@lucaslcode this definitely scrolls to the bottom on window resize, but im not yet sure about the keyboard biz

ahh wait, im not cleaning up my event listener again

Haven't looked thoroughly but you'll only want to scroll if it was scrolled to the bottom before (if I am scrolled halfway through my messages and resize, I probably don't want it to go to the bottom)

Haven't looked thoroughly but you'll only want to scroll if it was scrolled to the bottom before (if I am scrolled halfway through my messages and resize, I probably don't want it to go to the bottom)

ah, yes good point lol ok ignore all this then hahaha

@lucaslcode
I'm thinking maybe something like onclick for the input window, but since we're not using Redux I'd annoyingly have to pass it up and down (and save the state in the parent of both), unless theres another way?

I think you can do it within InfiniteMessageList with clientHeight

Struggled with this one, and tried to make it as spaghetti free as possible, but please go ham with any ways to make it cleaner.
I'm also never sure how to handle useEffect/useLayoutEffect hooks that have no dependencies, but have a setState setter, because I don't want it just to run on load, but it's just yells warnings of infinite loops (which wont happen here).
It sends the view to the bottom of the message thread if the messageId changes (newest message is always at 0 index).
It also assumes we're at the bottom of the message thread (currentlyAtBottom) if the total height is less than the distance to the top and the view window, and sends us back to the bottom on window resize. Or doesn't if we're not at the bottom.
In case (like me) you weren't sure what these stood for:
scrollHeight:  height of the total messages (including offscreen)
scrollTop: distance to top of scrollHeight
clientHeight: height of view window

Ok this is looking much neater. Up to your opinion, but atm if you open the keyboard it'll send you back down to the latest message no matter where you were in the thread (like messenger does)


add support for more info fields

the transmission rpc spec file lists a few more keys in the response of torrent-get method. here are a few fields that are listed but are not supported by this crate:

peer-limit
pieces
pieceCount
pieceSize
rateDownload

are these intentionally not included because for some backward compatibility of the rpc version or something like that? if not i would be happy to open a PR.
this seems to be the case for more or less all the method calls. they only seem to take into account a limited number of fields.

just took a look at a PR from a different repo, seems like the above mentioned fields have been supported well before the latest RPC version.

I was not very much interested in those pieces and thus they were out. Feel free to extend the lib

I will close this issue for now. If you want to contribute yourself or catch anyone's attention to it, feel free to refer to this ticket


Bug in Connector topic link

Describe the bug
I start kafka-ui-connectors.yaml
There one KafkaConnect for two clusters with two connectors

source-activities topic exists only on local cluster and if I will tap to source-activities from Kafka-Connect section in secondLocal cluster I will get nonexistent page:

Set up
I start kafka-ui-connectors.yaml
Steps to Reproduce
Steps to reproduce the behavior:

Start kafka-ui-connectors.yaml
Open section

Tap to

Could not reproduce this for "kafka-ui-connectors.yaml", please see attached screenshot.


Backend on PHP.md file header() is probably wrong

My mistake, my apache server is prepending own headers which I didn't notice earlier. Can delete this issue


Fix UG H1 color

My bad, the prev one didn't change the UG H1 color. This one should.

Duplicate pr


CAM Linear

Hi!
I'm working with CAM and the linear score which I need doesn't work... Running:
from cdt.causality.graph import CAM
X = np.random.random((1000, 30))
df = pd.DataFrame(X)
obj = CAM(score="linear")
output = obj.predict(df)

produces the error:
R Process Error Output
-----------------------
Le chargement a nÃ©cessitÃ© le package : glmnet
Le chargement a nÃ©cessitÃ© le package : Matrix
Loaded glmnet 4.0-2
Le chargement a nÃ©cessitÃ© le package : mboost
Le chargement a nÃ©cessitÃ© le package : parallel
Le chargement a nÃ©cessitÃ© le package : stabs
This is mboost 2.9-3. See âpackage?mboostâ and ânews(package  = "mboost")â
for a complete list of changes.

Attachement du package : âmboostâ

The following object is masked from âpackage:glmnetâ:

    Cindex

Le chargement a nÃ©cessitÃ© le package : mgcv
Le chargement a nÃ©cessitÃ© le package : nlme
This is mgcv 1.8-33. For overview type 'help("mgcv-package")'.
Warning message:
replacing previous import âglmnet::Cindexâ by âmboost::Cindexâ when loading âCAMâ
Error in scoreUpdate - scoreNodes[j] :
  argument non numÃ©rique pour un opÃ©rateur binaire
Calls: CAM -> updateScoreMat
De plus : Warning message:
In mclapply(seq_len(n), do_one, mc.preschedule = mc.preschedule,  :
  all scheduled cores encountered errors in user code
ExÃ©cution arrÃªtÃ©e

Leaving the default score ie "non-linear" works tho.
I'm working with version 0.5.21.
Thanks for your help!
Otherwise, the package is great, thank you very much!!

Hello,
Thanks for noticing this! I'll look into it ! (i'll transfer the issue to the main repo)
Best,
Diviyan

I posted the same message on the other repo :)

Ah! great, I'll close this one then :) !


Output "title" entities' contents as CDATA

Instead of encoding the file name as an URI, wrap the contents of the "title" entities into a CDATA section.

This PR is weird and doesn't allow for further editing. Closing it and inviting @FilippoBiga to open a new, proper one.