create docker container

There have been calls for the creation of a docker container that folks can use for The Workbench so that they can use something similar to make docker.
The docker container should be relatively straightforward to implement and we can implement two flavours:

slim with just R, pandoc, and the necessary packages with room to expand for other packages. This would be used if people want to render without previews.
fully featured with RStudio, R, and pandoc so that folks can work to preview their lessons.

Both of these can be based on containers from the Rocker Project or the base image for the R-Universe project where we can set the MY_UNIVERSE environment variable.

I've added a docker/ folder that contains a dockerfile and readme. It should be improved.

This looks neat! Alas, I don't think we can leverage WASM yet because support for R in WASM is currently limited to https://github.com/georgestagg/webR#demo, and while it is possible to install and use R packages in the WASM, the process is extremely difficult at the moment (https://github.com/georgestagg/webR/issues/11). Moreover, there is no support for pandoc in WASM that we can use.

Ah, true. Well, hopefully as it comes out of beta, things can change. I'd be happy to help with implementing the container. From above, essentially make two containers, one that contains R, pandoc, etc. and another fully featured one with RStudio, yes?

Building the Container
Sort of. I think building the container is fairly straightforward (at least it will be far less complex than https://github.com/carpentries/lesson-docker because we will be adding packages on top of an existing system instead of trying to shoehorn the jekyll build system in to the RStudio container or vice-versa).
Right now the bare-bones Docker setup is https://github.com/carpentries/workbench/blob/d134ed1cb85a09b4a5e95d97597350a86503cec2/docker/Dockerfile, which uses the R-Universe container as a base (though preview is not possible).
I believe an equivalent one with RStudio included would be to replace r-universe/base with rocker/rstudio from the rocker project (or rocker/geospatial for the r-geospatial lessons): https://rocker-project.org/images/versioned/rstudio.html
User interaction with the container
The remaining issue of how to mount volumes, expose ports for previewing, and figure out how to get it to write to the system not as the root user is another matter that is likely solved with docker-compose, but that's currently beyond my technical capabilities (see https://rocker-project.org/images/versioned/rstudio.html#how-to-use for an overview of the array of possibilities)
One big caveat is how to handle the packages for lessons that use R-markdown. Since {renv} uses a global package cache with symbolic links, all of those symbolic links will be broken inside of the container and thus, while we mount the lesson itself inside of the container, we need to ignore the renv/profiles/lesson-requirements/renv/ (which I think is addressed by https://stackoverflow.com/questions/29181032/add-a-volume-to-docker-but-exclude-a-sub-folder, but it either requires a very long user command or a docker-compose file).

Hi! I am looking into it and would be happy to help :)

I have a naive docker + docker-compose setup at https://github.com/alee/python-novice-gapminder/commit/0de50c735f4e32f9da953eb3cc278de6e96ff0b9 that should work for lessons that don't have the R-markdown issue raised earlier. Adding a secondary bind mount volume that supports a container-local {renv} should be pretty straightforward though by adding another bind mount for renv:./renv/profiles/lesson-requirements/renv/ or something similar into the docker-compose.yml file. What's a good r-markdown lesson to test that on though?
Not sure I understand why rstudio support would be needed, is it for the R-markdown lessons also?
The image name in docker-compose.yml should be templated for each specific lesson also.

Thanks @fherreazcue - I just tried this out and it is working great! I'm using it with a minimalist docker-compose.yml e.g.,
services:
  server:
    image: ghcr.io/uomresearchit/sandpaper:latest  # switch to `latest_arm` for macos
    volumes:
      - ./:/siteroot
    ports:
      - "<IP_ADDRESS>:4321:4321"

and it works like a charm and much smaller than the 5 GB R images that were being generated earlier :sweat_smile:


Correct way to close an env?

Hello! What is the recommended way to close an env such that all file handles are properly closed/deleted?
I was running some benchmarks involving heed and ran into "too many open files". So after some digging, I distilled my code down to this test:
#[test]
fn drop_env_deletes_file_handles() {
    let pid = std::process::id();
    let old_num_fds = num_fds(pid);

    let tmp_dir = tempdir::TempDir::new("test").unwrap();
    let lmdb_path = tmp_dir.path().join("testdb");
    let lmdb_map_size = 10 * 1024 * 1024 * 1024;

    std::fs::create_dir_all(&lmdb_path).unwrap();
    let env = unsafe {
        heed::EnvOpenOptions::new()
            .max_dbs(7)
            .map_size(lmdb_map_size)
            .open(&lmdb_path)
            .unwrap()
    };

    drop(env);
    drop(tmp_dir);

    assert_eq!(num_fds(pid), old_num_fds);
}

fn num_fds(pid: u32) -> usize {
    std::fs::read_dir(format!("/proc/{pid}/fd"))
        .unwrap()
        .count()
}

Much to my surprise, this test fails!
I know I can work around this by calling env.prepare_for_closing().wait(); instead of drop(env).
However, just to make sure I understood the library correctly, is drop(env) not supposed to close file handles? Or is this potentially a bug?
Thanks!

Hey @guozirui33 👋
The env is kept in memory so that if you try to open it multiple times in multiple threads, it opens it only once. Opening the same env multiple times in a program is disallowed with LMDB.
So, yeah, using the prepare_for_closing and waiting for it is the way to go. That's the only way when you share the env across threads by using an Arc internally.
Have a nice day 🌞

Apologies for the super delayed response. Thank you for your explanation, that makes sense to me!


fix: updated links to use dynamic validator moniker and link to mints…

…can for them
Description
Links in staking flow did not go to mintscan and had a hardcoded validator name. This sends the user to mintscan of the respective validator.

Notice

[x] Have you followed the guidelines in our Contributing guide?
[x] Have you checked to ensure there aren't other open Pull Requests for the same update/change?

Pull Request Type

[x] :bug: Bug fix (Non-breaking Change: Fixes an issue)
[ ] :hammer_and_wrench: Chore (Non-breaking Change: Doc updates, pkg upgrades, typos, etc..)
[ ] :nail_care: New Feature (Breaking/Non-breaking Change)

Issue (if applicable)
closes #1393

Risk
Minimal risk if any.

Testing
When staking or unstaking, on the confirm page clicking on the validator name should open a new tab and take the user to the mintscan link of the validator's address.

Screenshots (if applicable)

That's good for now but it would be nice-to-have something similar to explorerAddressLink and explorerTxLink in the Asset type specifically for validators page, maybe something like explorerValidatorAddress? Otherwise, we won't be able to handle different validator base URLs for different chains in the Cosmos SDK, nor will we be able to handle different blockchains altogether.
That's probably the subject of a whole new discussion, as it would require changes in a few places in lib and make the Asset type non-chain-agnostic anymore but rather, tied to PoS chains.
The idea of a metadata field we've discussed before with @majorhayes and @0xdef1cafe seems like it could be a great fit for that.

@gomesalexandre I was thinking the same thing, but for now, this will suffice.


How to ignore certificate validation

Because it could be useful for others it could be good to add some documentation on how to ignore certificate validation for e.g. self signed certificates.
Basically you need to inject your own HttpClient with a modified HttpClientHandler.
const string dsmUrl = "http://<IP_ADDRESS>:5001/";

var handler = new HttpClientHandler();
//This disables all certificate validation. It is not recommended (especially in production)!
handler.ServerCertificateCustomValidationCallback = (message, cert, chain, errors) => true;

var httpClient = new HttpClient(handler);

var client = new SynologyClient(dsmUrl, httpClient);

Sounds good. I've added your example to the to the README file. Thanks


fix: @ember/test-waiters must be a peer dependency

See explanation: https://github.com/NullVoxPopuli/ember-resources/issues/403#issuecomment-1048404119
tldr: peerDeps are the only way to guarantee that modern packagers
only load one version (specified by the consumer)
Interesting discovery while testing this:

locally, the embroider try scenarios succeed :upside_down_face:

@NullVoxPopuli I don't see any change here which makes test-waiters a peerDependency? Looking on master it's still in dependencies

bah, I must have confused myself during a rebase :(


[Bug] [complement] Startup parameters cannot update global variables

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
Startup parameters cannot update global variables

x Version is normal

What you expected to happen
Startup configuration parameters can override the update global variables, otherwise a workflow cannot start multiple instances with different global variables
How to reproduce
The boot parameter setting of the complement updates the global variable
Anything else
No response
Version
2.0.x
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

@SbloodyS You can assign me. Can i ask that if i should develop base on the latest branch of 2.x for maintaining 2.x version?

@SbloodyS You can assign me. Can i ask that if i should develop base on the latest branch of 2.x for maintaining 2.x version?

Yes.

@ShawshankLin Actually, start parameters can override global parameters in version 3.x, do you mean that's a bug in 2.x version and have to be solved in next 2.x version?

yes


MetaDraw Fragmentation Reanalysis

Enables the reanalysis of a fragmentation spectrum with additional fragment ion types.
The plotting methods use the MatchedIons of the psm that gets passed in to determine what to plot. To enable this functionality, I had to temporarily replace the fragment ions in the psm with the new matched ions, then put the original ions back in once the plotting has finished.
To use: have your normal MetaDraw Display

Select the additional ions you want to search for

His the search button. The persist check box will enable this research on all new PSMs you plot

pretty cool. i only ever see yAmmoniaLoss. maybe we need unit tests for each of the ion types? sounds like lots of work...... I wonder if we paste a couple of example spectra into proteinprospector if it sees any other fragments.

pretty cool. i only ever see yAmmoniaLoss. maybe we need unit tests for each of the ion types? sounds like lots of work...... I wonder if we paste a couple of example spectra into proteinprospector if it sees any other fragments.
That is a good idea and maybe a good starter project. Our current tests only truly test b, y, and c ions

is the top supposed to look like this?

i think that export spectrum library should maybe contain the newly annotated fragments.

is the top supposed to look like this?

This has been fixed


[Feature]: Deprecate jest-repl

🚀 Feature Proposal
It's (IMO) not providing much value. It was supposed to be deprecated in v28 (then v29), but I forgot both times 😅
https://github.com/jestjs/jest/pull/12735#issuecomment-1108556747
Filing an issue and adding to the milestone should hopefully make sure it's not forgotten.
Motivation
Less code is better
Example
No response
Pitch
n/a

I could help to solve this too.

Thanks! A PR removing all traces of it would be very much welcome 👍

I wonder, can it be useful for Detox? We were thinking recently about REPL feature for E2E tests.

https://github.com/wix/Detox/issues/4239


Heartbeat not working in newer versions of OPC Publisher

We are currently using full Industrial IOT deployment version 2.7.183. And this bug/issue concerns opc publisher.
Heartbeat does not work as we expect it to work, i.e, static values are not read in every hearbeat interval.
We tested different versions to be sure:
2.5: Works
2.6: Works
2.7: Does not work
2.7.183: Does not work
2.7.206: Does not work (latest version)
Steps to reproduce the behavior:

Deploy Industrial IOT (2.7.183)
Add an edge device.
Add opc publisher with heartbeat interval set (also has a opc server it can read from)
Depoy different versions of the pulisher itself to check it works differently

Expected behavior
When heartbeat interval for example 10 seconds is set, publisher should retrieve even static data (data that does not change)
every 10 seconds and send to IoTHub.
Edge running on

OS: Ubuntu 20.04 Desktop (Running on VM)

Could you please share some more details? I've just tested it with iot-edge-opc-plc with 60 nodes and it worked.

Which version did you test ?

2.8.0 (LTS)

Right, as mentioned in the issue all those versions tested were older. So, its great that it is fixed in the new version (if it is)

Just for my understanding. I just tested standalone (because you mentioned 2.5 and this is only available for standalone). Your testing of 2.6/2.7 was in standalone or orchestrated mode (as part of Industrial IoT Platform) ?

It has been a while now, but I think as described it is part of the orchestrated mode.

I've tested also 2.8 in orchestrated mode and it works now.

Thank you, I will look into it.


Directory Structure Misconfiguration

Description of the Issue:
In the setup of our Django project using the Cookiecutter template, there was a misunderstanding or misconfiguration regarding the definition of BASE_DIR. Initially, BASE_DIR was intended and expected to be the parent of the project root directory. However, in practice, BASE_DIR was configured as the project root directory itself, leading to discrepancies in the way directories and paths were handled within the project setup.
Current Manual Fix:
We adjusted the BASE_DIR to correctly reflect its intended purpose as the parent directory of the project root. This involved modifying the path definitions in the settings file to align with the actual directory structure, ensuring that all references to project components (like static files, media files, and application directories) were correctly pointed.
Long-Term Recommendations:
To prevent such issues in future setups:
Clarify Directory Definitions: It's crucial to ensure that the definitions and uses of BASE_DIR, APPS_DIR, and similar directory variables are clearly documented and consistently implemented throughout the project template. This prevents confusion about what each directory variable is supposed to represent.
Template Validation: After updating the template or its documentation, validating the changes by creating new projects and verifying that the directory structure conforms to the expected layout is necessary. This helps catch any discrepancies early.
Feedback and Iteration: Encourage users of the template to provide feedback on any issues or unexpected behaviors related to directory structures or setup processes. Use this feedback to iteratively improve the template.
What happened?
What should've happened instead?
Additional details

Host system configuration:

Version of cookiecutter CLI (get it with cookiecutter --version):

OS name and version:
On Linux, run
lsb_release -a 2> /dev/null || cat /etc/redhat-release 2> /dev/null || cat /etc/*-release 2> /dev/null || cat /etc/issue 2> /dev/null

On MacOs, run
sw_vers

On Windows, via CMD, run
systeminfo | findstr /B /C:"OS Name" /C:"OS Version"

# Insert here the OS name and version

Python version, run python3 -V:

Docker version (if using Docker), run docker --version:

docker compose version (if using Docker), run docker compose --version:

...

Options selected and/or replay file:
On Linux and macOS: cat ${HOME}/.cookiecutter_replay/cookiecutter-django.json
(Please, take care to remove sensitive information)

Logs:

$ cookiecutter https://github.com/cookiecutter/cookiecutter-django
project_name [Project Name]: ...

Someone changed the BASE_DIR variable and you are now blaming the documentation?


Default locale

Hi there,
thanks for this plugin! I was wondering if it's possible to define a default locale or if you have plans to implement something like that. Or are there other ways to manage that?
Cheers!

Well what do you imagine under a default locale? Do you mean the user being redirected to /en by default? You'd have to implement that by yourself.
Check out root-index.html. This page has a / permalink which means to omit the :language URL placeholder. Thus, although the page is in English as per implementation, it is placed directly inside the destination directory.
Also, look into the YAML front-matter wiki page.

I have implemented automatic language redirect for the example page. Check out the commit 27e6c422c7b7a68f86874c83ffabd8e1c65f7b82.

A default that does not render inside a subdirectory is what I thought about. I know there are other ways to do, but I wanted to know what your thoughts are about it. Thanks for the example and the explanation!

Hello! Sorry to resurrect a closed issue but I think this issue could use some further thought. This plugin does a very good job of implementing localization. I'm glad I found it.
Unfortunately a javascript redirect to a default language is considered sub-optimal in my case. For an opensource project our default language is English and we are attempting to support multiple languages going forward. Not having a default language pollutes my default URI scheme a bit and doesn't give the best user experience. There are other javascript location redirects that happen in my default page that will conflict with the localization redirect. Additionally, some care is going into the URI scheme to enhance SEO optimization and I don't think a default redirect is optimal for indexing. Even with the root-index.html solution, any clicks off the main page will cause links to happen to /en instead of the default lang.
My hope for using this plugin is that the project will always use english as it's default documentation source and we can slowly recruit volunteers to provide further translations.
I've attempted to duplicate page content without language settings in hopes that it would create a 'default' view in the destination directory, but I receive build errors
  Liquid Exception: No language specified for current page or post. in _layouts/skeleton.html

Is there any other work around for this?

The exception is being triggered because you probably removed the language YAML front-matter from one of the pages of the example site. That is of course not working since the skeleton layout requires a page or post to have a language.
What you want is a language_default setting which directs the plugin to omit the /:language URL template prefix so you can have a nicer URI scheme.

:+1:  for this.. any suggestion?

@calmyournerves
If you are looking for a fallback language you can achieve this with markdown standard.
I did this, I have on lang.yml with multiple translations but not every language has a translation (just to reduce redundant data) and still Jekyll works. The trick is to use links. Here is a snippet of my lang.yml file:
# English (default)
# -----------------
en: &DEFAULT_EN
  site:
    title: Jekyll
    description: Welcome

# German
# -----------------
de: &DEFAULT_DE
  <<: *DEFAULT_EN
  site:
    description: Willkommen
at:
  <<: *DEFAULT_DE
chde:
  <<: *DEFAULT_DE
    description: Grüezi

Result: the swiss site (chde) inherits the translation from german site (de), the german site (de) inherits from english site (en), for all keys not included in the specific language. In the example the key site is the same in all languages, key description is different in en, de and chde but not in at.
Hope this is the answer you are looking for.
Viele Grüße nach Zürich aus Luzern.

Hi @vwochnik ,
I have checked your plugin. Looks better than others and also easy to understand. I have to ask one thing - Is there any update in setting a default language for a site? What I need is exactly the one described in #18
Thanks in advance.
Happy coding!!!!

And how do you implement this fallback on a xml file? (I need my default lang to be the english one) I have my feed.xml and I need the following behavior:
mysite.com/es/feed.xml
mysite.com/en/feed.xml
And:
mysite.com/feed.xml (I can't redirect here to /en/, so a 404 error is shown)
Any workaround for this?

I still think it would be great to have a languages fallback system. Having this
en:
  title: Jekyll
  desc: Hello

fr:
  desc: Bonjour

but something even better would be to also be able to get the french title if it doesn't exist in english


can not scroll horizontally

can not scroll horizontally:

value is not displayed:

can not do column wider:

You cannot scroll single column.
But you can:

Use plaintext mode
Run "Columns pack: fit values"
Open value view panel to see full value.

And I can't eproduce problem with empty value view panel.
BTW what PG database/driver do you use?

BTW what PG database/driver do you use?

probably default. I just install DBeaver and use it.

Use plaintext mode

can not, because of https://github.com/dbeaver/dbeaver/issues/6238

Run "Columns pack: fit values"

where this options is available?

Open value view panel to see full value.

https://github.com/dbeaver/dbeaver/issues/6239#issuecomment-509214753
value is not available for explain analyse queries

You cannot scroll single column.

Why not if it does not fit window?

In order to support scrolling of individual columns will require to make some brand new UI. Generally it is not applicable to spreadsheet.
Long values should be edited in value panel or in editor dialog (shift+enter). I can't reproduce the problem with empty value editor.
Do you have some SQL query which will help me to reproduce it?

I have, but, as you can see, this query over 10+ tables. I am not sure I can provide DDL fro all of them


Android local file share doesn't share contents of file

Steps to reproduce

Attempt to share a local text file via Share.open using the local path as described in the docs, e.g. url: "file:///storage/emulated/0/test.txt"

Expected behaviour
The contents of the file should be shared to the selected app
Actual behaviour
Instead of the file contents the file url is shared to the app, e.g. if I share to Gmail the string "file:///storage/emulated/0/test.txt" is copied into the email.
Environment

React Native version: .55.3
React Native platform + platform version: Android 8.1.0

react-native-share
Version: 1.1.2

I see this too, same steps for reproduction.

when i share file of pdf.i add next code in option obejct.Add it works ok.
                const options = {
                  url: `file://${item.path}`,
                  type: 'application/pdf',
                  showAppsToView: true,
                  title: `${item.name || ''}`
                };

so add  type: 'application/pdf', try again.or other.

Weird, but it's not working for me in iOS. There is no content to share. Base64 working well except Whatsapp

Have the same issue; my code works well on iOS, but on Android, it sends the string of the path.
Also what @suwu150 suggested didn't work for me :/
export async function send(path)
{
Share.open({
	title: strings.share,
	message: strings.shareMessage,
	url: path,
	type: 'application/pdf',
	subject: strings.shareSubject,
	}).then((res) => {
		console.log('CORTEX: TKT_371: send(): res: '+res)})
		.catch((err) => {console.log('CORTEX: TKT_373: send(): error for some reason: '+err);});
}

(variable path looks like something like this:
/data/user/0/com.appName/cache/123456.pdf)
@acb did you find a solution? :pray:

@watchtower314 add below code
add app/src/main/AndroidManifest.xml
        <provider
            android:name="android.support.v4.content.FileProvider"
            android:authorities="${applicationId}.provider"
            android:grantUriPermissions="true"
            android:exported="false">
            <meta-data
                tools:replace="android:resource"
                android:name="android.support.FILE_PROVIDER_PATHS"
                android:resource="@xml/filepaths" />
        </provider>

and  in res/xml/filepaths.xml
<?xml version="1.0" encoding="utf-8"?>
<paths xmlns:android="http://schemas.android.com/apk/res/android">
    <external-path name="myexternalimages" path="Download/" />
    <root-path name="root" path="" />
    <files-path
        name="files-path"
        path="." /> <!-- Used to access into application data files -->
</paths>

@suwu150 's solution did the trick! Although at first it seemed not to work; it caused a different error that  said failed to find configured root that contains /file:/storage/emulated/0/123456.pdf but after removing the app from my device and rebuilding, it worked perfectly!
Thanks!!

Great!

App it's work, but don't share the image:
        <TouchableOpacity onPress={()=>{           Share.open({             url: 'file:///src/imgs/share.png',             type: 'image/png'           });         }}>           <View>             <Text>Share Image Test</Text>           </View>         </TouchableOpacity>

For me working


Wrong casting (mixed precision) in attention layers

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Google Colab
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: No
TensorFlow installed from (source or binary): Google Colab
TensorFlow version (use command below): v2.4.0-0-g582c8d236cb 2.4.0
Python version: 3
Bazel version (if compiling from source): No
GCC/Compiler version (if compiling from source): No
CUDA/cuDNN version: No
GPU model and memory: No

Describe the current behavior
When using Attention or AdditiveAttention with mixed precision policy issue occurred due to wrong casting (mask casted to floatx but should be casted to scores.dtype)
Describe the expected behavior
Layers should work without issues with mixed_fp16
Standalone code to reproduce the issue
https://colab.research.google.com/drive/1R2MKXAIrmYBBGkij11m9aG7hLm2AEHjF?usp=sharing
Other info / logs Include any logs or source code that would be helpful to
diagnose the problem. If including tracebacks, please include the full
traceback. Large logs and files should be attached.
The issue comes from here https://github.com/tensorflow/tensorflow/blob/v2.4.0/tensorflow/python/keras/layers/dense_attention.py#L129
Should be this:
scores -= 1.e9 * math_ops.cast(padding_mask, dtype=scores.dtype)

I have tried in colab with TF version 2.4, Nightly version(2.5.0-dev20201229) and was able to reproduce the issue. Please, find the gist here. Thanks!

Added a PR #46321 for the fix.

Added a PR #46321 for the fix.


Limit alias info popup size #5415 RELENG_2_2

This is code for RELENG_2_2 pfSense 2.2.5 that will limit the number of rows in the alias info popup to 100.

Note: I expect that this works, but it is a quick demo of limiting the length of alias entries displayed in the popup - all the various types of long alias need to be tested. The final limit would need to be decided (50 suggested in the issue in Redmine). And of course necessary code engineered for however this works in 2.3

merged, thanks!


parsing 'const' seems to be broken when using clang parser

Version and Platform (required):

Binary Ninja Version: 3.1 dev using clang parser

Bug Description:
Navigate to a char const array

hit y

hit enter

This makes a const array of const chars, which prints weirdly (char const const [10]) but doesn't affect functionality or analysis-- it just looks weird.

This will be fixed in dev >= 3.1.3723


VLCLog event is fubar and incorrect

The VLCLog event is currently raised only on the original VLCInstance instance, and never on other instances. This is wrong; VLCLog events should be raised on the appropriate instance of VLCInstance according to the Context parameter of the callback.

Logging related code was removed in commit da6e5f45ab169d80a819dbb2c5244d6fffd7063e.


Compare Classes/Jar

Hello, i did some reverse on this Jar but i swear i don't remember what i changed (was on a 12 hour analysis so yea hard to remember it all and i didn't really take notes), is there any way i can compare all the classes in the jar with another jar (the unmodified version)? (bytecode)

If you check out the WIP 3x releases this feature sort-of exists:
https://user-images.githubusercontent.com/21371686/233784793-3df846f1-7dcd-46b0-b9c3-4a7e99dbf725.mp4

If you check out the WIP 3x releases this feature sort-of exists:
java_Uur5ktzyJZ.mp4

hi, thanks for the reply; from what i understand, this only work if you haven't closed the workspace yet?

This is correct. Having a more comprehensive jar comparison scheme is planned, but not yet implemented yet.

This is correct. Having a more comprehensive jar comparison scheme is planned, but not yet implemented yet.

Aight, thanks. Is there any way to export all the classes' bytecode to a .txt or something? So i can use notepad++ to compare...

Not currently, but a disassembly based text comparison strategy is what is roughly planned for the future.
3X has a WIP class-level assembler. You can go that route for now, or do basic decomp diffs.

You can use https://github.com/sfPlayer1/Matcher for comparing JARs

IntelliJ idea can compare jars quite nicely too, even in the community edition.


Draining of nodes should be killed after a certain time

Right now the machine-controller drains nodes before deleting them.
If a node has pods which cannot be drained (Container runtime has issues) the machine-controller won't delete that node.
To avoid keeping broken nodes, the drain process should be limited in time.
When the drain process reaches the timeout, the drain should be considered succeeded.

Lets use 2 hours as timeout


Monitoring of client connections in MQTT server

Does the MQTT server monitor the connected MQTT clients ? For instance if a MQTT client does not send any data (not even ping requests) for some time, would the server force the disconnection of the client, after a server side configured keep-alive delay expires ?

https://github.com/chkr1011/MQTTnet/blob/4fed80c2d0c9e08e4364700eaf358bb37ed28d6f/Source/MQTTnet/Server/IMqttServerOptions.cs#L12

Thx for the links.
I set the TimeSpan for the WithDefaultCommunicationTimeout option of MqttServer to 10 seconds, and I connected a MQTT Client (mosquitto_sub) which has the KeepAlive set to 30 seconds to it. The MQTT ping requests are in this case sent to the MQTT server every 30 seconds, but the MQTT Server does not close the client connection after 10 (15 seconds), actually it does not close it at all.
What would be the interpretation of the normative statement [MQTT-3.1.2-24]  ?

If the Keep Alive value is non-zero and the Server does not receive a Control Packet from the Client 538 within one and a half times the Keep Alive time period, it MUST disconnect the Network Connection to the 539 Client as if the network had failed

MQTT 3.1.1 Specification

@abrasat The _DefaultCommunicationTimeout _ is a general timeout on socket level. It is used in a lower layer (TCP) than the keep alive which is MQTT specific. Generally you do not need to alter the values of DefaultCommunicationTimeout. It is only exposed for special edge cases.

@chkr1011 :  I still do not understand which timeout does the MQTT server then use to monitor the client connections, as requested in the MQTT specification?


Unable to verify pre-built binaries

Expected Behavior
Users of this package should be able to download pre-built binaries and verify integrity of the binary by using the publisher's public key. This package uses cosign to sign and verify artifacts in the build pipeline, but the public key is not exposed publicly, so users cannot verify the binaries.  If one had the access to a public key public-key.pub they should be able to run this command to verify the binary has not been tampered with and is genuine:
cosign verify-blob -key public-key.pub -signature opw_macOS_arm64.tar.gz.sig opw_macOS_arm64.tar.gz

Output should be a zero exit code.
Current Behavior
Lack of public key results in:
Error: verifying blob [opw_macOS_arm64.tar.gz]: invalid signature when validating ASN.1 encoded signature
main.go:62: error during command execution: verifying blob [opw_macOS_arm64.tar.gz]: invalid signature when validating ASN.1 encoded signature

Possible Solutions

Publish the public signing key somewhere that can be accessed publicly.
Use a PGP key and upload to public keyservers (e.g. Keybase), provide the fingerprint in the documentation

For example, Hashicorp provides their PGP public key on their website: https://www.hashicorp.com/security
Context
Your Environment

Cosign version used:

GitVersion:    1.13.1
GitCommit:     d1c6336475b4be26bb7fb52d97f56ea0a1767f9f
GitTreeState:  "clean"
BuildDate:     2022-10-17T18:00:05Z
GoVersion:     go1.19.2
Compiler:      gc
Platform:      darwin/arm64

Operating System and version (desktop or mobile): MacOS 12.3

Public key available at https://keybase.io/twdps


Status of this Project, Optimisation and increase of resolution

Hi,
thank you for publishing this great project!
It is really impressive what you managed to do via a USB connection.
Now, are there any updates to this project or did you abandon it?
I would like to hack on the input lag problem as long as there is any chance of optimising it:
The 9.7" EPD from waveshare has a fairly low resolution (1200x825) but there are panels with a higher resolution (1872×1404). Is there a bottleneck when sending framebuffer data via USB to the IT8951? An increase in the display's resolution might hurt performance even more.
Best Regards
Hugo Melder

Hi Hugo,
This project has been abondoned by me. Mostly because I'm a relative newbie to C and the various tooling needed to manage dependancies. Getting it to build on newer versions of e.g. Ubuntu was a constant hassle for me.
With that said, the code does work and it's not too bad. I'd be keen to give you a hand getting it back up and running if you'd like. Expecially if you have a better understanding than I around C packaging.

Is there a bottleneck when sending framebuffer data via USB to the IT8951? An increase in the display's resolution might hurt performance even more.

If I remember correctly, the amount of data being transferred wasn't a massive issue. There is an inherent latency every time you want to send a message, so sending more messages will be slower. But sending the same number of messages with more data in them should be fine. That's the USB <-> IT8951 part of the picture anyway.
The actually display refreshing part is a bit more of a mystery. I've been able to get much faster refreshes in certain cases (epd_demo.c in this repo for example). But I haven't been able to replicate those speeds in this repository, once all the infrastructure around it is in place.
My understanding (if I remember correctly from the last time I looked into it), is that the primary source of latency was actually from getting frames off the GPU, then onto the CPU for sending to the USB device.
This is something that I believe is fixable by using different system calls (and making some trade-offs). But I haven't had the time to investigate this properly.
Best,
Dan

Thank you for the comprehensive explanation. It looks like the amount of time required to optimise the sending of framebuffer data is huge but very interesting non the less. I'm actually thinking about buying a waveshare hdmi (fpga based) panel. What do you think?

On Wednesday, November 17, 2021 12:34 CET, Dan Jones @.***> wrote:

Hi Hugo,
This project has been abondoned by me. Mostly because I'm a relative newbie to C and the various tooling needed to manage dependancies. Getting it to build on newer versions of e.g. Ubuntu was a constant hassle for me.
With that said, the code does work and it's not too bad. I'd be keen to give you a hand getting it back up and running if you'd like. Expecially if you have a better understanding than I around C packaging.
Is there a bottleneck when sending framebuffer data via USB to the IT8951? An increase in the display's resolution might hurt performance even more.
If I remember correctly, the amount of data being transferred wasn't a massive issue. There is an inherent latency every time you want to send a message, so sending more messages will be slower. But sending the same number of messages with more data in them should be fine. That's the USB <-> IT8951 part of the picture anyway.
The actually display refreshing part is a bit more of a mystery. I've been able to get much faster refreshes in certain cases (epd_demo.c in this repo for example). But I haven't been able to replicate those speeds in this repository, once all the infrastructure around it is in place.
My understanding (if I remember correctly from the last time I looked into it), is that the primary source of latency was actually from getting frames off the GPU, then onto the CPU for sending to the USB device.
This is something that I believe is fixable by using different system calls (and making some trade-offs). But I haven't had the time to investigate this properly.
Best,
Dan
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.
Triage notifications on the go with GitHub Mobile for iOS or Android.

I'm actually thinking about buying a waveshare hdmi (fpga based) panel.

To be honest I would do that if I were you. It seems like a lot less faff!


Are custom metrics still in preview?

The documentation on this page states that custom metrics are still in preview, that "custom metrics will incur costs when they enter general availability", and that "the ability to publish custom metrics is available only in a subset of Azure regions".
However, the linked pricing page does include pricing details for custom metrics, and the REST API documentation doesn't include a region name in the endpoint.
The documentation around custom metrics is therefore a little confusing for me. Are these still in preview, or are they generally available and this page just needs updating?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 09e9e6a7-4b37-e559-f719-63199aa78a0a
Version Independent ID: 398a63dd-0e08-9ff3-da4e-e26fb50cb287
Content: Custom metrics in Azure Monitor (Preview) - Azure Monitor
Content Source: articles/azure-monitor/platform/metrics-custom-overview.md
Service: azure-monitor
Sub-service: metrics
GitHub Login: @AncaV
Microsoft Alias: ancav

@cgwrench -
Thanks for brining this to our attention. We will investigate it further and update you shortly.

@cgwrench - Thanks again for reaching out. Custom Metrics are still in preview and doc is up to date.
At this moment, Since there is no doc update required, We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.


AutoImport for internal package in monorepo stops working if more than a few dependencies are installed

🔎 Search Terms
"intellisense not working", "auto import", "autoimport", "internal package", "monorepo internal"
🕗 Version & Regression Information

This is the behavior in every version I tried, and I reviewed the FAQ for entries "tsconfig.json Behavior" and other mentions of "import" "intellisense" or "module".

Versions checked
❯ every-ts switch main
HEAD is now at 5df3a107c0 Update dependencies (#58639)

❯ every-ts switch 5.5
HEAD is now at b574864abc Update LKG

❯ every-ts switch 5.1
HEAD is now at 6e4aa901f2 Bump version to 5.1.6 and LKG

❯ every-ts switch 4.8
HEAD is now at a614119c19 Bump version to 4.8.4 and LKG

❯ every-ts switch 5.5
HEAD is now at b574864abc Update LKG

❯ every-ts switch 5.3
HEAD is now at 3a36bec244 🤖 Pick PR #56626 (Directly copy only the index signat...) into release-5.3 (#56709)

❯ every-ts switch 5.2
HEAD is now at 9684ba6b0d Cherry-pick fix for cross-file inlay hints (#55476) to release-5.2 and LKG (#55487)

I've used VS Code Insiders so I don't have any excess extensions (just WSL).
Version: 1.90.0-insider (system setup)
Commit: c6e45e96a6b0fe94e0dae5b13ab4167d69ec9788
Date: 2024-05-28T10:48:57.080Z
Electron: 29.4.0
ElectronBuildId: 9593362
Chromium: 122.0.6261.156
Node.js: 20.9.0
V8: 12.2.281.27-electron.0
OS: Windows_NT x64 10.0.19045

⏯ Playground Link
No response
💻 Code
Reproduction Repo
See:
https://github.com/michaelschufi/repro-monorepo-tsserver-import
Internal Package
package.json
{
  "name": "@repo/ui",
  "version": "0.0.0",
  "private": true,
  "main": "./dist/index.js",
  "exports": {
    "./button": "./src/button.tsx",
    "./card": "./src/card.tsx",
    "./code": "./src/code.tsx",
    "./get-foo": "./src/get-foo.ts",
    "./get-foobar": "./src/get-foo-bar.ts"
  },
  "scripts": {
    "lint": "eslint . --max-warnings 0",
    "generate:component": "turbo gen react-component"
  },
  "dependencies": {
    "typescript": "*"
  },
  "devDependencies": {
    "@repo/eslint-config": "workspace:*",
    "@repo/typescript-config": "workspace:*",
    "@turbo/gen": "^1.12.4",
    "@types/node": "^20.11.24",
    "@types/eslint": "^8.56.5",
    "@types/react": "^18.2.61",
    "@types/react-dom": "^18.2.19",
    "eslint": "^8.57.0",
    "react": "^18.2.0",
    "typescript": "^5.3.3"
  }
}

get-foo.ts
export const getFoo = () => "foo"
export const getBar = () => "bar"

pnpx tsc --showConfig
{
    "compilerOptions": {
        "declaration": true,
        "declarationMap": true,
        "esModuleInterop": true,
        "incremental": false,
        "isolatedModules": true,
        "lib": [
            "es2022",
            "dom",
            "dom.iterable"
        ],
        "module": "nodenext",
        "moduleDetection": "force",
        "moduleResolution": "nodenext",
        "noUncheckedIndexedAccess": true,
        "resolveJsonModule": true,
        "skipLibCheck": true,
        "strict": true,
        "target": "es2022",
        "jsx": "react-jsx",
        "outDir": "./dist"
    },
    "files": [
        "./src/button.tsx",
        "./src/card.tsx",
        "./src/code.tsx",
        "./src/get-foo-bar.ts",
        "./src/get-foo.ts"
    ],
    "include": [
        "src",
        "src/get-foo-bar.ts"
    ],
    "exclude": [
        "node_modules",
        "dist"
    ]
}

App using internal package
package.json
{
  "name": "web",
  "version": "1.0.0",
  "private": true,
  "scripts": {
    "dev": "next dev",
    "build": "next build",
    "start": "next start",
    "lint": "eslint . --max-warnings 0"
  },
  "dependencies": {
    "@clerk/localizations": "^2.4.3",
    "@clerk/nextjs": "^5.1.2",
    "@tanstack/react-query": "^5.39.0",
    "@trpc/client": "11.0.0-rc.377",
    "@trpc/react-query": "11.0.0-rc.377",
    "@trpc/server": "11.0.0-rc.377",
    "@upstash/redis": "^1.31.3",
    "@repo/ui": "workspace:*",
    "lodash": "^4.17.21",
    "next": "^14.1.1",
    "react": "^18.2.0",
    "react-dom": "^18.2.0",
    "superjson": "^2.2.1",
    "zod": "^3.23.8"
  },
  "devDependencies": {
    "@next/eslint-plugin-next": "^14.1.1",
    "@repo/eslint-config": "workspace:*",
    "@repo/typescript-config": "workspace:*",
    "@types/eslint": "^8.56.5",
    "@types/lodash": "^4.17.4",
    "@types/node": "^20.11.24",
    "@types/react": "^18.2.61",
    "@types/react-dom": "^18.2.19",
    "eslint": "^8.57.0",
    "typescript": "^5.3.3"
  }
}

page.tsx
const Page = () => {
  // import suggestion for lodash is working
  const bar = sum(1, 2)

  // internal @repo/ui package exports don't work
  const foo = getFoo();
  const bar = getBar();

  return (
    // also not in jsx
    <Card>

Hello, world!

Welcome to your new app!

  );
};

export default Page;

pnpx tsc --showConfig
{
    "compilerOptions": {
        "declaration": true,
        "declarationMap": true,
        "esModuleInterop": true,
        "incremental": false,
        "isolatedModules": true,
        "lib": [
            "es2022",
            "dom",
            "dom.iterable"
        ],
        "module": "esnext",
        "moduleDetection": "force",
        "moduleResolution": "bundler",
        "noUncheckedIndexedAccess": true,
        "resolveJsonModule": true,
        "skipLibCheck": true,
        "strict": true,
        "target": "es2022",
        "plugins": [
            {
                "name": "next"
            }
        ],
        "allowJs": true,
        "jsx": "preserve",
        "noEmit": true
    },
    "files": [
        "./next-env.d.ts",
        "./next.config.js",
        "./app/route.ts",
        "./app/layout.tsx",
        "./app/page.tsx"
    ],
    "include": [
        "next-env.d.ts",
        "next.config.js",
        "**/*.ts",
        "**/*.tsx",
        ".next/types/**/*.ts"
    ],
    "exclude": [
        "node_modules"
    ]
}

🙁 Actual behavior
Import suggestions for an internal package stop working if the number of installed dependencies grows too large. This already happens with as little as ~12 dependencies.
Reproduction
The reprodution repo is basically just Turborepo's basic example with a few dependencies added to showcase the autoimport failing.
pnpm dlx create-turbo@latest

from (Turborepo Getting Started).
It uses the strategy for internal packages outlined here Turborepo Internal Packages - which is already preconfigured in the example.
Initial Steps

Clone the repo from https://github.com/michaelschufi/repro-monorepo-tsserver-import.
Go to the apps/web folder.
Install the dependencies using pnpm pnpm i
Open apps/web/app/page.tsx and try to import-suggest the getFoo function.
Observe it not working.

Observing the strange behavior

Remove a few dependencies (e.g. the first 3, I didn't try removing next, react or react-dom)
Rerun pnpm i to remove them from node_modules.
Restart the TS Server in VS Code.
Observe the import suggestion showing the internal package import.

You can remove any other dependencies (as shown in the video). It doesn't matter which ones. I tried the following
"@clerk/localizations": "^2.4.3", // <-- Group 1
"@clerk/nextjs": "^5.1.2", // <-- Group 1
"@tanstack/react-query": "^5.39.0", // <-- Group 1
"@trpc/client": "11.0.0-rc.377",
"@trpc/react-query": "11.0.0-rc.377",
"@trpc/server": "11.0.0-rc.377", // <-- Group 3, not shown in the video
"@upstash/redis": "^1.31.3", // <-- Group 3, not shown in the video
"@repo/ui": "workspace:*",
"lodash": "^4.17.21",
"next": "^14.1.1",
"react": "^18.2.0",
"react-dom": "^18.2.0",
"superjson": "^2.2.1", // <-- Group 2
"zod": "^3.23.8" // <-- Group 2

Removing any ?random? group of packages, makes the import work.
https://github.com/microsoft/TypeScript/assets/2805598/4bbab7d3-281b-4239-b4b2-9358bdcfde4b
Note
The imports start showing up, if at least one file in the project has imported the file already.
E.g. page.tsx imports
import { getFoo } from "@repo/ui/get-foo";

then, all imports from "@repo/ui/get-foo" are available when triggering the suggestion. Even if we are in e.g. layout.tsx.
But the imports from other paths of the internal package e.g. "@repo/ui/get-foobar" are not.
🙂 Expected behavior
I expect the imports to be working regardless of how many dependencies I have installed.
Additional information about the issue
Possibly related issues:

#39778 - this one seems to be close
#48880 - especially this comment https://github.com/microsoft/TypeScript/issues/48880#issuecomment-1863484041
#36708

Below are the tsserver logs. Note the following lines in the first one
Info 282  [10:21:34.464] AutoImportProviderProject: attempted to add more than 10 dependencies. Aborting.

https://gist.github.com/michaelschufi/638a0a9bc5bc8568c86b50a8c0c0e723

Set "Include Package JSON Auto Imports" to "On" instead of "auto"

Thank you so much! This seems to fix it 😀
Now, since it's not the default, I have to ask: What are the implications regarding performance if I enable that?
Maybe there could be some kind of whitelist, so we can include the internal packages in the VS Code settings?

Set "Include Package JSON Auto Imports" to "On" instead of "auto"

You save my life... thanks... 😂

OMG, that's a game changer!

This issue has been marked as "Question" and has seen no recent activity. It has been automatically closed for house-keeping purposes.

I'd be curious to know that too


Can't update MAS version of 1Password 7

I'm not sure if this problem is related to MAS apps in general or 1Password 7 specifically.
I had previously installed the MAS version of 1Password via Jamf and used that with no problems. I tried to replace that with their web site version (added functionality) via Installomator v. 0.4 (via Jamf policy and separately independent of Jamf). Either way, I get the "Quit and Update" dialog box and select that option. After 3 tries, it fails. I tried checking Activity Monitor and adding "blocking processes" and ended up with this label:
1password7)
    name="1Password 7"
    type="pkg"
    downloadURL="https://app-updates.agilebits.com/download/OPM7"
    expectedTeamID="2BUA8C4S2C"
    blockingProcesses=( "1Password 7" "1Password Extension Helper" "1PasswordNativeMessageHost" "1Password (Safari)" )
    ;;

Installomator succeeded after I manually deleted 1Password 7 from /Applications.
Screenshots:

That last screenshot is what I got when I first tried to drag 1Password to the Trash. After killing all the processes via Activity Monitor, I was able to delete it.
Jamf's error before adding blocking processes:
[STEP 1 of 5]
--
Executing Policy 1Password-Installomator
[STEP 2 of 5]
Running script Installomator...
Script exit code: 11
Script result: 2020-11-18 11:11:27 shifting arguments for Jamf
2020-11-18 11:11:27 ################## Start Installomator
2020-11-18 11:11:27 ################## 1password7
2020-11-18 11:11:27 no blocking processes defined, using 1Password 7 as default
2020-11-18 11:11:27 Changing directory to /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.Rnw5UIpL
2020-11-18 11:11:28 found app at /Applications/1Password 7.app, version 7.6
2020-11-18 11:11:28 found blocking process 1Password 7
2020-11-18 11:11:44 telling app 1Password 7 to quit 26:30: execution error: 1Password 7 got an error: User canceled. (-128)
2020-11-18 11:11:45 waiting 30 seconds for processes to quit
2020-11-18 11:12:15 found blocking process 1Password 7
2020-11-18 11:13:40 telling app 1Password 7 to quit 26:30: execution error: 1Password 7 got an error: User canceled. (-128)
2020-11-18 11:13:41 waiting 30 seconds for processes to quit
2020-11-18 11:14:11 found blocking process 1Password 7
2020-11-18 11:14:15 telling app 1Password 7 to quit 26:30: execution error: 1Password 7 got an error: User canceled. (-128)
2020-11-18 11:14:15 waiting 30 seconds for processes to quit
2020-11-18 11:14:45 ERROR: could not quit all processes, aborting...
2020-11-18 11:14:45 Deleting /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.Rnw5UIpL
2020-11-18 11:14:45 ################## End Installomator
Error running script: return code was 11.
[STEP 3 of 5]
[STEP 4 of 5]
Inventory will be updated when all queued actions in Self Service are complete.
[STEP 5 of 5]

Jamf's error with the blocking processes added:
[STEP 1 of 5]
--
Executing Policy 1Password-Installomator
[STEP 2 of 5]
Running script Installomator...
Script exit code: 11
Script result: 2020-11-18 15:03:19 shifting arguments for Jamf
2020-11-18 15:03:19 ################## Start Installomator
2020-11-18 15:03:19 ################## 1password7
2020-11-18 15:03:19 Changing directory to /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.onDI3Rjp
2020-11-18 15:03:19 found app at /Applications/1Password 7.app, version 7.6
2020-11-18 15:03:19 found blocking process 1PasswordNativeMessageHost
2020-11-18 15:03:26 telling app 1PasswordNativeMessageHost to quit
2020-11-18 15:03:26 waiting 30 seconds for processes to quit
2020-11-18 15:03:56 found blocking process 1PasswordNativeMessageHost
2020-11-18 15:03:59 telling app 1PasswordNativeMessageHost to quit
2020-11-18 15:03:59 waiting 30 seconds for processes to quit
2020-11-18 15:04:29 found blocking process 1PasswordNativeMessageHost
2020-11-18 15:04:32 telling app 1PasswordNativeMessageHost to quit
2020-11-18 15:04:33 waiting 30 seconds for processes to quit
2020-11-18 15:05:03 ERROR: could not quit all processes, aborting...
2020-11-18 15:05:03 Deleting /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.onDI3Rjp
2020-11-18 15:05:03 ################## End Installomator
Error running script: return code was 11.
[STEP 3 of 5]
[STEP 4 of 5]
Inventory will be updated when all queued actions in Self Service are complete.
[STEP 5 of 5]

Terminal error:
2020-11-18 14:33:31 ################## Start Installomator
2020-11-18 14:33:31 ################## 1password7
2020-11-18 14:33:31 no blocking processes defined, using 1Password 7 as default
2020-11-18 14:33:31 Changing directory to /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.8OgFDEgJ
2020-11-18 14:33:31 found app at /Applications/1Password 7.app, version 7.6
2020-11-18 14:33:31 found blocking process 1Password 7
2020-11-18 14:33:35 telling app 1Password 7 to quit
26:30: execution error: 1Password 7 got an error: User canceled. (-128)
2020-11-18 14:33:35 waiting 30 seconds for processes to quit
2020-11-18 14:34:05 found blocking process 1Password 7
2020-11-18 14:34:18 ERROR: user aborted update
2020-11-18 14:34:18 Deleting /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.8OgFDEgJ
2020-11-18 14:34:18 ################## End Installomator

It succeeded after I manually deleted 1Password 7 from /Applications.

[STEP 1 of 5]
--
Executing Policy 1Password-Installomator
[STEP 2 of 5]
Running script Installomator...
Script exit code: 0
Script result: 2020-11-18 15:09:24 shifting arguments for Jamf
2020-11-18 15:09:24 ################## Start Installomator 2020-11-18 15:09:24 ################## 1password7 2020-11-18 15:09:24 Changing directory to /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.zZPMu1g4
2020-11-18 15:09:24 Spotlight not returning any app, trying manually in /Applications.
2020-11-18 15:09:24 could not find 1Password 7.app
2020-11-18 15:09:24 no more blocking processes, continue with update
2020-11-18 15:09:24 Downloading https://app-updates.agilebits.com/download/OPM7 to 1Password 7.pkg
2020-11-18 15:10:06 Verifying: 1Password 7.pkg
2020-11-18 15:10:06 Team ID: 2BUA8C4S2C (expected: 2BUA8C4S2C )
2020-11-18 15:10:06 Installing 1Password 7.pkg to / installer: Package name is 1Password 7 installer: Installing at base path / installer: The install was successful.
2020-11-18 15:10:29 found app at /Applications/1Password 7.app, version 7.7
2020-11-18 15:10:30 Installed 1Password 7, version 7.7
2020-11-18 15:10:30 notifying 2020-11-18 15:10:34 Deleting /var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/tmp.zZPMu1g4
2020-11-18 15:10:34 ################## End Installomator
[STEP 3 of 5]
[STEP 4 of 5]
Inventory will be updated when all queued actions in Self Service are complete.
[STEP 5 of 5]

This Slack thread may have some info pertinent to quitting 1Password 7.

Hi @SmithersJr
If I go through the link to Slack and your above suggestion, I get this for blockingProcesses:
blockingProcesses=( "1Password Extension Helper" "1Password 7" "1Password (Safari)" "1PasswordNativeMessageHost" "1PasswordSafariAppExtension" )
I have not deployed 1Password like this, so do not have any experience, but we should find the processes that needs to be quit, and then we will see how it works. I do not know if we really need the two last items.
We have version 0.5 in dev, and it includes version checking as well. If you can, please check with that. it would be a great help.
Thank you!


Added the delete_date: dry_run=yes

Type of change
Note: Fill x in []

[x] bug
[ ] enhancement
[ ] documentation
[ ] dependencies

Description
Added the delete_date: dry_run=yes, if it running on dry_run=yes

For security reasons, all pull requests need to be approved first before running any automated CI

@athiruma test failed, pls check !!!
Is any error because this issue ?


feat: port Algebra.Order.Interval

todo:

[ ] NonemptyInterval.subtractionCommMonoid errors with sub_eq_add_neg and neg_add_rev
[ ] NonemptyInterval.divisionCommMonoid same thing

Pushed some fixes. It was necessary to apply two ext lemmas to recover the output of the ext from Mathlib3.
Beware when naming instances that there is already a namespace so it is not necessary to add it to the instance name.

I'm working on the positivity extension.

bors d+


Use framework APIs to retrieve information needed for login portal, instead of query params

Is your feature request related to a problem? Please describe.
Use framework APIs to retrieve information needed for login portal, instead of query params

Duplicate of https://github.com/wso2/product-is/issues/8979


helm3 update - changes to get the template rendered

hasKey fails with helm3
uncommented the global.namespaceOverride in values.yaml to keep the conditional logic simple

@mforutan Can you please review since you added the original change? It looks okay to me.

/ok-to-test

FYI installing mongodb-replicaset chart version 3.14.1 based on this PR change results in the following warning:
2020/05/13 23:42:49 Warning: Merging destination map for chart 'mongodb-ha'. The destination item 'global' is a table and ignoring the source 'global' as it has a non-table value of: <nil>
2020/05/13 23:42:49 Warning: Merging destination map for chart 'mongodb-ha'. The destination item 'global' is a table and ignoring the source 'global' as it has a non-table value of: <nil>

3.14.0 works OK.

Kubectl v1.18.2
Helm v2.16.7


Adding new resources in Web Development file

@shivam0110 change the PR title to exactly what does the PR do, like what the changes it will produce to the repo

@shivam0110 change the PR title to exactly what does the PR do, like what the changes it will produce to the repo

Done

Looks Good :sparkles:. Thanks

Looks Good ✨. Thanks

Yeah, no problem

One more thing, Bootstrap is a CSS Framework and not JS framework.

@shivam0110 create new PR for these changes


[HOLD for payment 2024-03-07] [$500] Android - Task - Keyboard does not open after selecting task title

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 1.4.44-0
Reproducible in staging?: Y
Reproducible in production?: N
Logs: https://stackoverflow.com/c/expensify/questions/4856
Issue reported by: Applause-Internal Team
Action Performed:

Open the app and log in
Open the task assigned to you or create one
Tap the task title

Expected Result:
The keyboard opens, and the title field is in focus
Actual Result:
The keyboard does not open, and the title field is not in focus
Workaround:
Unknown
Platforms:

Which of our officially supported platforms is this issue occurring on?

[x] Android: Native
[ ] Android: mWeb Chrome
[ ] iOS: Native
[ ] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
https://github.com/Expensify/App/assets/115492554/c75939a7-5fef-427a-943f-ffccc44bdb72

View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~01476b0db32bd2022c
Upwork Job ID:<PHONE_NUMBER>116813312
Last Price Increase: 2024-02-27

We think that this bug might be related to #vip-vsb
CC @quinthar

Proposal
Please re-state the problem that we are trying to solve in this issue.
The keyboard does not open, and the title field isn't in focus.
What is the root cause of that problem? Likely related to the focus management of the input field, which should trigger the keyboard to appear.
What changes do you think we should make in order to solve the problem? Check that the input component is configured properly, make sure TextInput isn't being obstructed or improperly managed by layout components.
What alternative solutions did you explore?

Contributor details
Your Expensify account email<EMAIL_ADDRESS>Upwork Profile Link: https://www.upwork.com/freelancers/~01de573da854537dcf

Proposal
Please re-state the problem that we are trying to solve in this issue.
Task title input is not focused on load
What is the root cause of that problem?
InputWrapper for TaskTitle page is missing autoFocus prop
https://github.com/Expensify/App/blob/668df99bfa6bad36978622e9c5685db70077f56b/src/pages/tasks/TaskTitlePage.js#L100
What changes do you think we should make in order to solve the problem?
Add autoFocus prop to InputWrapper component in taskTitle page
<InputWrapper
 autoFocus
 InputComponent={TextInput}
 role={CONST.ROLE.PRESENTATION}
 inputID={INPUT_IDS.TITLE}

What alternative solutions did you explore? (Optional)
None

@aswin-s this is deploy blocker. There should be offending PR

Proposal
Please re-state the problem that we are trying to solve in this issue.
The task title field is not focused after opening the task title edit view when creating or editing a task.
What is the root cause of that problem?
The title input is not autofocused when the screen is open.
What changes do you think we should make in order to solve the problem?
We can make use of the useAutoFocusInput hook to autofocus the input field, which is the preferred approach to autofocusing text inputs in the codebase.
What alternative solutions did you explore? (Optional)
None.

Proposal
Updated
Some formatting updates.

I think this came from https://github.com/Expensify/App/pull/29991, same root cause as https://github.com/Expensify/App/issues/37156, https://github.com/Expensify/App/issues/37252. didScreenTransitionEnd is not called in android.
cc: @hannojg

As I think here:
shouldEnableKeyboardAvoidingView={false} in src/pages/tasks/NewTaskPage.js set keyboard to not avoid view, maybe it's solution, I'm not expert in it.

Contributor details
Your Expensify account email<EMAIL_ADDRESS>Upwork Profile Link: https://www.upwork.com/freelancers/~0174b2192b46da02d0

Native stack PR was reverted.

@situchan - thanks for the summary. @mananjadhav let's review if we should fix this issue here or address it in the respective GHs listed here:
https://github.com/Expensify/App/issues/37273#issuecomment-1966360093

We have some proposals here too ready for review. Thanks!

This fix already reached staging

Awesome, looks like automation kicked in here.

Heads up, I will be offline until Tuesday, March 5, 2024. I will not be actively watching over this GitHub during that period. If anything urgent is needed here, please ask for help in the Open Source Slack Room-- thanks!

Please assign me here for reviewing PR

@mananjadhav - I reviewed the PR and only see action by @situchan. Can you share the PR related to your actions for a PR related to this GitHub? Thanks! I'm trying to complete the payment process and want to make sure that I'm not missing a C+ review. Thanks!

@alexpensify here's context

Yes I didn't work on this issue. The PR was solving multiple regressions, and I was afk. Hence I asked to reassign.

Thanks for the context! I wasn't aware of the Slack post and wanted to double-check that there wasn't a split here.

@situchan - Please accept here:
https://www.upwork.com/jobs/~01476b0db32bd2022c
After, I can complete the required process. Thanks!

Here is the payment summary:

External issue reporter - N/A
Contributor that fixed the issue - N/A
Contributor+ that helped on the issue and/or PR - @situchan $500

Upwork Job: See above

All set, everyone has been paid in Upwork here.


Add support to load lite or full implementations.

Codecov Report

Merging #360 into master will increase coverage by 0.02%.
The diff coverage is 83.33%.

@@             Coverage Diff              @@
##             master     #360      +/-   ##
============================================
+ Coverage     88.96%   88.99%   +0.02%
- Complexity      545      547       +2
============================================
  Files            93       93
  Lines          2121     2135      +14
  Branches        163      163
============================================
+ Hits           1887     1900      +13
- Misses          199      201       +2
+ Partials         35       34       -1

Impacted Files
Coverage Δ
Complexity Δ

api/src/main/java/io/opencensus/trace/Tracing.java
88.88% <80%> (-3.97%)
7 <1> (ø)

...n/java/com/google/instrumentation/stats/Stats.java
86.66% <84.61%> (+26.66%)
5 <2> (+2)
:arrow_up:

...google/instrumentation/stats/StatsManagerImpl.java
100% <0%> (ø)
1% <0%> (?)

...n/java/io/opencensus/trace/TraceComponentImpl.java
100% <0%> (ø)
1% <0%> (?)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3b74070...b44a64c. Read the comment docs.


fix bin path connection in __phpbrew_set_path()

Hi, @c9s !
I fixed that the phpbrew bin path is not connected when $PHPBREW_BIN is blank in phpbrew binary file.
related issus: https://github.com/phpbrew/phpbrew/pull/634

Hi,
That diff, or the lack of diff, doesn't look right. What's going on here? :)

Same as https://github.com/phpbrew/phpbrew/pull/641#issuecomment-164626249
You probably want to edit the shell/bashrc file https://github.com/phpbrew/phpbrew/blob/master/shell/bashrc and pull request.

@marcioAlmada
Sorry, I just edit the binary file. :cry:
Thank you for your comment.


rootston: Segfault on closing some XWayland windows with opened drop down menu

Commit: 868ad5af69583646ba71d6e73e362818c7416941
Reproduction: Open some X11 application, for instance vlc, and exit via drop down menu.
Result:
Thread 1 "rootston" hit Breakpoint 1, roots_seat_set_focus (seat=0x561f7c9d7d00, view=0x561f7cd2fe00) at ../rootston/seat.c:713
713                     wl_list_remove(&view->link);
1: view = (struct roots_view *) 0x561f7cd2fe00
2: view->link = {prev = 0x0, next = 0x0}
(gdb) c
Continuing.
Thread 1 "rootston" received signal SIGSEGV, Segmentation fault.
0x00007f9d7e607137 in wl_list_remove () from /usr/lib/libwayland-server.so.0
(gdb) bt
#0  0x00007f9d7e607137 in wl_list_remove () at /usr/lib/libwayland-server.so.0
#1  0x0000561f7b178265 in roots_seat_set_focus (seat=0x561f7c9d7d00, view=0x561f7cd2fe00) at ../rootston/seat.c:713
#2  0x0000561f7b17809e in seat_view_destroy (seat_view=0x561f7ccc0ce0) at ../rootston/seat.c:656
#3  0x0000561f7b1780ce in seat_view_handle_destroy (listener=0x561f7ccc0d18, data=0x561f7ccedf60) at ../rootston/seat.c:663
#4  0x0000561f7b16f819 in wl_signal_emit (signal=0x561f7ccee038, data=0x561f7ccedf60) at /usr/include/wayland-server-core.h:388
#5  0x0000561f7b1709ba in view_finish (view=0x561f7ccedf60) at ../rootston/desktop.c:387
#6  0x0000561f7b17bdca in handle_destroy (listener=0x561f7cd48328, data=0x561f7cb3a7a0) at ../rootston/xwayland.c:124
#7  0x00007f9d7e86278f in wlr_signal_emit_safe (signal=0x561f7cb3a880, data=0x561f7cb3a7a0) at ../util/signal.c:29
#8  0x00007f9d7e829bb8 in wlr_xwayland_surface_destroy (xsurface=0x561f7cb3a7a0) at ../xwayland/xwm.c:215
#9  0x00007f9d7e82ac1c in xwm_handle_destroy_notify (xwm=0x561f7cc4aa00, ev=0x561f7cc46a00) at ../xwayland/xwm.c:600
#10 0x00007f9d7e82b8aa in x11_event_handler (fd=15, mask=1, data=0x561f7cc4aa00) at ../xwayland/xwm.c:979
#11 0x00007f9d7e6049b2 in wl_event_loop_dispatch () at /usr/lib/libwayland-server.so.0
#12 0x00007f9d7e60314c in wl_display_run () at /usr/lib/libwayland-server.so.0
#13 0x0000561f7b1739b2 in main (argc=1, argv=0x7ffe7dde8a18) at ../rootston/main.c:81

Segfault occurs at line 713:
https://github.com/swaywm/wlroots/blob/868ad5af69583646ba71d6e73e362818c7416941/rootston/seat.c#L709-L715
Additional check for view->link.next fixes this issue.

Which vlc package are you using? My vlc doesn't have any gui with dropdowns.
Since both next and prev are NULL it looks like it's trying to remove a view, that was already removed previously.
Dropdown menus in X are their own windows, so my first guess would be something is going wrong when two windows get closed at the same time.
Is this a consistent way to reproduce the crash no your end? I didn't get it with firefox.

Try Media -> Quit in vlc. It happens consistently in Qt applications. I'm able to reproduce this with virtualbox and with any qt tool installed on my system, like assistant.

Hmm, I suppose I'm talking about toolbar menu.

I don't have any. I'm building and installing vlc-qt5 from the aur atm to reproduce.
I'm semi-suire this is caused by an unmapped window (which would be the dropdown menu).
The code that handles those is https://github.com/swaywm/wlroots/blob/868ad5af69583646ba71d6e73e362818c7416941/rootston/xwayland.c#L256-L279
This removes the window from the desktop (L278) which sets the link pointers to NULL, but does not emit view->events.destroy, so the seat_view persists, and the seat tries to focus it, when the main window is removed.

Ok, can reproduce with QT_QPA_PLATFORM=xcb konsole.
Can also confirm a view that was unmapped is given to roots_seat_set_focus.

Unmapped views are a mess. @acrisci, maybe wlr_xwayland should emit the xsurface destroy signal when they are unmapped? (since we already wait for the surface to be mapped before emitting the new_surface signal)


Install the ceph repo only on x86

On Power we are able to pull the ceph packages directly from Ubuntu.

:+1:


[csrng,doc] Clarifications on TRNG mode and use of derivation function

Some clarifications based on the answers provided in this issue: https://github.com/lowRISC/opentitan/issues/16203

I am merging this PR as it touches documentation only. All relevant CI steps for this passed successfully.


Truncate pwd string if > 53 characters

Navigating in deeply nested directories resulted in pwd strings that
were too long for my tastes. I found a github issue where string
truncation prompt sequences are used in zsh. I modified this theme to do
the same.
http://zsh.sourceforge.net/Doc/Release/Prompt-Expansion.html#Conditional-Substrings-in-Prompts
https://github.com/wesbos/Cobalt2-iterm/issues/15

Wider Terminal Window (no truncation):

More Narrow Terminal Window (truncation):

working as intended 👍


update test

In order to streamline the review of the contribution we ask you
to ensure the following steps have been taken:

[x] Filename in the lowercase format
[x] Image format: png
[x] Image size: 256 by 256 px

Added to correct directory https://github.com/TrustWallet/tokens/commit/730fdf8c4b6fa23e25343f5b40677126e42be296
Also, you can use these graphics to say that your ERC20 token fully compatible with Trust Wallet (https://trustwalletapp.com/logo-assets). Tokens will show up automatically once the user receives them.
Feel free to share this on social media and tag Trust Wallet:

Twitter: @trustwalletapp

Facebook: @trustwalletapp


Scrolling server-side production build error

Current behavior
Getting production build error for Scrolling server-side.
Getting error as  "Directive ɵc, Expected 2 arguments, but got 1"
Error pointing to ngx-datatable tag
if i remove  (scroll)="onScroll($event.offsetY)" its building successfully
  <ngx-datatable
  #table
  class="material server-scrolling-demo"
  [rows]="rows"
  [offset]="tableOffset"
  [headerHeight]="headerHeight"
  [footerHeight]="footerHeight"
  [rowHeight]="rowHeight"
  [columnMode]="ColumnMode.force"
  [loadingIndicator]="isLoading"
  [scrollbarV]="true"
  [scrollbarH]="true"
  (scroll)="onScroll($event.offsetY)"
  >

Expected behavior
It has to build successfully

Table version:
ngx-datatable version - ^16.1.1

Angular version:
Angular version : 8.3.20

Browser: [all | Chrome XX | Firefox XX | IE XX | Safari XX | Mobile Chrome XX | Android X.X Web Browser | iOS XX Safari | iOS XX UIWebView | iOS XX WKWebView ]

Language: [all | TypeScript X.X | ES6/7 | ES5]

hard to tell without seeing the onScroll function. But it might be the same bug I got into. As the (scroll) listener catches both the scrollEvent from ngx-datatable(https://swimlane.gitbook.io/ngx-datatable/api/table/outputs#scroll) and the Element scroll https://developer.mozilla.org/en-US/docs/Web/API/Element/scroll_event your function needs to handle this.


Small DI Improvements

This PR contains some small improvements to DI:

af8c90e. This just fixes some style nits.
d25328f. This adds a new option to DI that causes DI to trigger an assertion when DI emits an error. This is only meant for use by compiler devs when working with DI in the debugger.

rdar://31521023

@swift-ci smoke test and merge


Directions crash when accessToken is not provided - it should use token from MGLMapboxAccessToken

Steps to reproduce

Set token using MGLAccountManager.accessToken = "123123"
Create object Directions()

Expected behavior
Directions should be properly initialized with a token set using MGLAccountManager.accessToken if not provided via parameter or info.plist
Actual behavior
There is a crash. Check this internal implementation of init:
public init(accessToken: String?, host: String?) {
    let accessToken = accessToken ?? defaultAccessToken
    precondition(accessToken != nil && !accessToken!.isEmpty, "A Mapbox access token is required. Go to <https://account.mapbox.com/access-tokens/>. In Info.plist, set the MGLMapboxAccessToken key to your access token, or use the Directions(accessToken:host:) initializer.")
    ...
}

it uses accessToken from parameter or defaultAccessToken which is the one from info.plist. However, it is not using MGLAccountManager.accessToken.

I was trying to add ??  MGLAccountManager.accessToken in init in Directions.swift but I see that you don't have access to the Mapbox module there.

By design, MapboxDirections.swift doesn’t depend on the map SDK, though the navigation SDK does. If an application is already programmatically setting MGLAccountManager.accessToken, it can pass MGLAccountManager.accessToken (or the access token as a string literal) into the Directions(accessToken:host:) initializer.


cis194 course is not active

Submitting register form gave an error. So I send e-mail to them. It seems that this course is set inactive.

You're not supposed to register for anything.

okay :-)

Hmm, so it's not possible to check your answers?

@rikvdkleij there's no official capacity for this. Most people ask on the IRC channel, you could search for answers as well but you should strive to avoid that.

Thanks for your reply.


Increase custom stuff coverage

This should finally fix the coverage in custom.jl

@Moelf that should be better now :)


test_enqueued_local_size should be redesigned

The test as it is relies on the fact that num_elements is not a multiple of 3 hard-coded numbers to be valid. It tests a single set of values and doesn't take into account the device limits when picking workgroup sizes for the test. It should be revised.
See https://github.com/KhronosGroup/OpenCL-CTS/pull/414.

A few more issues with this test:

compiles multiple programs when one would be enough
doesn't cover 3D case.

A few ideas for additional coverage:

We should test both "uniform" work groups and "remainder" work groups.
We should include the case where there are no "uniform" work groups and there are only "remainder" work groups; in other words where the global work size is smaller than the local work size.
In the 2D (and 3D) case, we should test each dimension.

Regarding the implementation:

The test verifies the results for the first (2D) dispatch, but immediately overwrites it by the second (1D) dispatch, so the test won't actually fail if the first dispatch is incorrect.
The test could be simplified by using the wrappers.
At least currently, the test compiles two programs but only uses one of them.
Since the test only writes data for a single work item, we should be able to get identical coverage by launching far fewer than num_elements work items in each dimension.


API-4749 SMART launch context with authorization code flow

Adds SMART launch context storing capability for the authorization code flow for configured IDP's.
https://vajira.max.gov/browse/API-4749
Some background on SMART launch context below
http://www.hl7.org/fhir/smart-app-launch/scopes-and-launch-context/#apps-that-launch-from-the-ehr
Main changes to look for:

Launch context should only be stored for the configured IDPs when using the authorization code flow
Client Credentials flow should continue unchanged
Refresh token calls should check if a launch context is associated and if so create an entry in the Launch Context table

Devops PRs:

https://github.com/department-of-veterans-affairs/devops/pull/8484
https://github.com/department-of-veterans-affairs/lighthouse-oauth-proxy-configs/pull/14

Added Devops PRs:

department-of-veterans-affairs/devops#8484
department-of-veterans-affairs/lighthouse-oauth-proxy-configs#14


Put wishlist into separate beer_list attribute

I have plans to fork the beer-card to make an untappd-wishlist-card as well to easily render this list along with the label images

IMO this change will be messy, why not loop though the attributes like the tracker-card?


Basic Synthesizers

Initially, we need basic synthesizers to be able to test our system. This should take advantage of Tone.js for actually producing the sound.
They should look something very similar to this: https://codepen.io/gridsound/pen/opEMyj
For now, we probably don't have to show the waveform and could just display text.

Was this fully taken care of with PR #28?


Footer

i have created an external CSS to make it easier for us to work on, and also imported a Google font

added external css and added google font


batch_size

What size of learning should be set for a 1024 * 1024 dataset_ Rate batch_ Size and num_ Epoch

Hello, thank for your question 🙏
For an image patch of 1024 x 1024, the batch_size will depend of your amount of available RAM on your computer. For exemple I run on a 256 x 256 patches image size and use a batch size of 16. On the metrics of my computer it fitted well, and may have enough RAM to get with a higher batch_size.
For the num of epochs, I choose 100 firstly and let the learning run for 3/4 hours and checked the results. They were satisfy
for me, and so didn't go further on the training, but if you want to get a better Dice Score, I think you can let it run a bit longer, it will surly improve the model.
For the learning rate, I picked 1e-3 which fit well with a small batch size, but if you get with a lower batch size (As if you get with a 1024 x 1024 images patches size), it's preferable to lower a bit the learning rate to not overfit on a single batch, and get with 1e-4 or even use other techniques as dropout (Need to be added directly on the model)
If you have any other question feel free to respond here :)

Why does the loss function not converge?

What are the parameters you used ?
I could be due to different one, and may need to figure out what are responsible for, and try to change them


Resume: 2020-2021 Worked for a known fraudster to facilitate his pump and dump scheme.

https://tinyurl.com/mapbujps (changed link to removeddit since /r/monero mod removed to try to cover it up - maybe fluffy himself?)

Spam or truth? There is only one way to find out. Look into the sources yourself.

tari-project/tari#2904

tari-project/tari#2893

tari-project/tari#2892

tari-project/tari#2859

tari-project/tari#2905

tari-project/tari#2903

tari-project/tari#2901

tari-project/tari#2899

tari-project/tari#2898


Issue with group filter when run as lambda

This ticket is related to #2454.
When policy is run as a Lambda function, the following messages appear in the CloudWatch logs:
[ERROR]	2018-06-05T22:20:12.415Z	79a5d662-690e-11e8-bd2d-d557592c4236	Error while executing policy
Traceback (most recent call last):
File "/var/task/c7n/policy.py", line 229, in run
resources = self.policy.resource_manager.resources()
File "/var/task/c7n/query.py", line 421, in resources
return self.filter_resources(resources)
File "/var/task/c7n/manager.py", line 90, in filter_resources
resources = f.process(resources, event)
File "/var/task/c7n/resources/iam.py", line 960, in process
for p in r['c7n:Groups']:
KeyError: u'c7n:Groups'
u'c7n:Groups': KeyError
Traceback (most recent call last):
File "/var/task/custodian_policy.py", line 4, in run
return handler.dispatch_event(event, context)
File "/var/task/c7n/handler.py", line 89, in dispatch_event
p.push(event, context)
File "/var/task/c7n/policy.py", line 739, in push
return mode.run(event, lambda_ctx)
File "/var/task/c7n/policy.py", line 504, in run
return PullMode.run(self)
File "/var/task/c7n/policy.py", line 229, in run
resources = self.policy.resource_manager.resources()
File "/var/task/c7n/query.py", line 421, in resources
return self.filter_resources(resources)
File "/var/task/c7n/manager.py", line 90, in filter_resources
resources = f.process(resources, event)
File "/var/task/c7n/resources/iam.py", line 960, in process
for p in r['c7n:Groups']:
KeyError: u'c7n:Groups'

Policy
policies:
  - name: mfa-unused-audit
    description: |
      Cloud Custodian MFA Admin Audit
    comments: |
      Retrieve list of all IAM users in the group 'CloudCustodianAdmins'
      who have not enabled MFA and delete their ssh-keys and access-keys.
      Also, disable access to management console.
    resource: iam-user
    mode:
      type: periodic
      role: arn:aws:iam::1234567890:role/CloudCustodianRole
      schedule: "rate(1 minute)"
    filters:
      - type: credential
        key: mfa_active
        value: false
      - type: group
        key: GroupName
        value: CloudCustodianAdmins
    actions:
      - type: delete
        options:
          - access-keys
          - ssh-keys
          - console-access

The policy runs clean when run locally.

Does this issue occur when running from master? I don't think this is related to the additional functionality added in that PR, rather this is an issue related to the group filter

You're right!
I'm getting the same errors when run from master.

Revised policy without the additional functionaility
policies:
  - name: iam-user-with-lambda
    resource: iam-user
    mode:
      type: periodic
      role: arn:aws:iam::1234567890:role/CloudCustodianRole
      schedule: "rate(1 minute)"
    filters:
      - type: credential
        key: mfa_active
        value: false
      - type: group
        key: GroupName
        value: CloudCustodianAdmins
    actions:
      - type: notify
        template: mfa-unused-disable
        template_format: 'html'
        template_slack: slack-mfa-unused-disable
        priority_header: '5'
        subject: 'Cloud Custodian: IAM User Admins Audit'
        to:
          -<EMAIL_ADDRESS>        transport:
          type: sqs
          queue: https://sqs.us-east-1.amazonaws.com/1234567890/sandbox

Error Logs
[ERROR]	2018-06-06T00:32:06.152Z	09408266-6921-11e8-b952-9b97ab72eee2	Error while executing policy
Traceback (most recent call last):
File "/var/task/c7n/policy.py", line 222, in run
resources = self.policy.resource_manager.resources()
File "/var/task/c7n/query.py", line 421, in resources
return self.filter_resources(resources)
File "/var/task/c7n/manager.py", line 90, in filter_resources
resources = f.process(resources, event)
File "/var/task/c7n/resources/iam.py", line 947, in process
for p in r['c7n:Groups']:
KeyError: u'c7n:Groups'
u'c7n:Groups': KeyError
Traceback (most recent call last):
File "/var/task/custodian_policy.py", line 4, in run
return handler.dispatch_event(event, context)
File "/var/task/c7n/handler.py", line 88, in dispatch_event
p.push(event, context)
File "/var/task/c7n/policy.py", line 669, in push
return mode.run(event, lambda_ctx)
File "/var/task/c7n/policy.py", line 468, in run
return PullMode.run(self)
File "/var/task/c7n/policy.py", line 222, in run
resources = self.policy.resource_manager.resources()
File "/var/task/c7n/query.py", line 421, in resources
return self.filter_resources(resources)
File "/var/task/c7n/manager.py", line 90, in filter_resources
resources = f.process(resources, event)
File "/var/task/c7n/resources/iam.py", line 947, in process
for p in r['c7n:Groups']:
KeyError: u'c7n:Groups'

I went ahead and changed the title to more accurately reflect the reported issue.

@thisisshi that fix in your commit looks good, wanna send a pr?

@kapilt it's already in https://github.com/capitalone/cloud-custodian/pull/2454, but I can pull it out if you want it in before the delete options feature instead

While the errors are no longer appearing, my group filter is not matching against any users when run as a Lambda.
Also, when I run my policy locally the group filter only matches when the GroupName is 'Administrators'.
If the GroupName anything else, the group filter shows no matches.
Temporary workaround is to run policy locally as a cron job -- but ideally, I would like to run it as a Lambda filtering against any custom GroupName given.


[fix](group commit) should set wal id in runtime_state when building pipeline task

after commit https://github.com/apache/doris/commit/85026759d6ed8d89240beb1b546b08c67db098d7, stream load using pipeline engine to load data, wal id should be setted in runtime_state when building pipeline task, like plan_fragment_executor does. Wal id in runtime_state is used to find wal file.
Proposed changes
Issue Number: close #xxx

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


Epic: provide pg_bm25 extension

Motivation
Requested by @acervantes23
DoD
pg_bm25 extension available for customers
Implementation ideas
Tasks
- [ ] Evaluate extension, gather use cases
- [ ] Gather dependencies
- [ ] Add extension to compute image
- [ ] Rollout extension

Other related tasks and Epics

https://blog.paradedb.com/pages/introducing_bm25
https://github.com/neondatabase/neon/issues/7014

Chi: creates it's own storage, doesn't use the PostgreSQL storage.

Request by a prospective customer (TagniFi). They plan to bring in around 2 TB of data.

They sell data via a console, downloadable dataset, api and a excel plugin. So their prod use case is mostly to enable this.

Timeline is more towards end of April.