GeoAI_2021_unit_04_EX_Prepare_your_data

Applying the function prepare_ds , I get the following error message:
2021-12-08 15:10:34.928189: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'nvcuda.dll'; dlerror: nvcuda.dll not found
2021-12-08 15:10:34.929902: W tensorflow/stream_executor/cuda/cuda_driver.cc:269] failed call to cuInit: UNKNOWN ERROR (303)
2021-12-08 15:10:34.932636: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:169] retrieving CUDA diagnostic information for host: LAPTOP-5NT7CML9
2021-12-08 15:10:34.933100: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:176] hostname: LAPTOP-5NT7CML9
2021-12-08 15:10:34.972827: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX AVX2
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
I think there is a problem with TensorFlow. At the beginning of this course we had to install it. I installed it in Miniconda and the example script that we have at the beginning worked. Any ideas to solve this problem?

@FloFranz  I have no Idea I made tests with the scripts that were available at the beginning of the course and it did work. so I have to hand over now to @Baldl

@FloFranz As far as I know  this message occurs when you have installed tensorflow on a CPU (as described in unit 1) and not a GPU. This message should not be a problem for further proceeding. Could you reshape your tensorflow dataset to an image?

@jp-hecht I can take a subset of the created array but the training_dataset and validation_dataset look like this:
<MapDataset shapes: ((None, None, None, None), (None, None, None, None)), types: (tf.float32, tf.float32)>

@FloFranz I think you have the desired output. The  None is just a placeholder for a (currently) unknown values.

When I try to install tensorflow it doesn't work, I get the following Error message:
ERROR: Could not find a version that satisfies the requirement tensorflow==2.7.* (from versions: none)
ERROR: No matching distribution found for tensorflow==2.7.*
WARNING: pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Could not fetch URL https://pypi.org/simple/pip/: There was a problem confirming the ssl certificate: HTTPSConnectionPool(host='pypi.org', port=443): Max retries exceeded with url: /simple/pip/ (Caused by SSLError("Can't connect to HTTPS URL because the SSL module is not available.")) - skipping
Error: Error installing package(s): ""tensorflow==2.7.*""
Any idea how to solve this?

@Puliester You may cross check the [answer from session 1] https://github.com/GeoMOER/geoAI/issues/2#issuecomment-979445574 I think your libraries asre not up to date so please check the suggested posible solutions.

Hello, i get also get Warningmessges, when i apply the prepare_ds function:
2021-12-12 12:49:09.885335: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/lib/R/lib:/lib:/usr/lib/x86_64-linux-gnu:/usr/lib/jvm/default-java/lib/server
2021-12-12 12:49:09.885371: W tensorflow/stream_executor/cuda/cuda_driver.cc:269] failed call to cuInit: UNKNOWN ERROR (303)
2021-12-12 12:49:09.885402: I tensorflow/stream_executor/cuda/cuda_diagnostics.cc:156] kernel driver does not appear to be running on this host (ivo-ThinkPad-X240): /proc/driver/nvidia/version does not exist
2021-12-12 12:49:09.885806: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations:  AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
And it seems that i get the right dataoutput afterwards:
<MapDataset shapes: ((None, None, None, None), (None, None, None, None)), types: (tf.float32, tf.float32)>
However, if i proceed and try to reshape i get the following error:
it <- as_iterator(training_dataset)
it <- tensorflow::iterate(as_iterator(training_dataset))
Error in py_iterate(it, f) :
InvalidArgumentError: input must have 3 channels but instead has 1 channels.
[[{{node adjust_saturation/AdjustSaturation}}]] [Op:IteratorGetNext]
I think this might be due to a wrong tensorflow installation but i dont know how to fix it.

@IvoJJ

I think this might be due to a wrong tensorflow installation but i dont know how to fix it.
You could simply check if tensorflow is working appropriate with
tf$constant("Hello Tensorflow")
Desired output:
`tf.Tensor(b'Hello Tensorflow', shape=(), dtype=string)´
or run the MNIST example from the first unit

Error in py_iterate(it, f) :InvalidArgumentError: input must have 3 channels but instead has 1 channels.[[{{node adjust_saturation/AdjustSaturation}}]] [Op:IteratorGetNext]
Maybe your input file path or the input image itself has the wrong number of channels e.g. you switched the mask with the image or vice versa. Please check this in your code.

@IvoJJ

I think this might be due to a wrong tensorflow installation but i dont know how to fix it.

You could simply check if tensorflow is working appropriate with
tf$constant("Hello Tensorflow")
Desired output:
tf.Tensor(b'Hello Tensorflow', shape=(), dtype=string)
or run the MNIST example from the first unit

Error in py_iterate(it, f) :InvalidArgumentError: input must have 3 channels but instead has 1 channels.[[{{node adjust_saturation/AdjustSaturation}}]] [Op:IteratorGetNext]

Maybe your input file path or the input image itself has the wrong number of channels e.g. you switched the mask with the image or vice versa. Please check this in your code.

W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory; LD_LIBRARY_PATH: /usr/lib/R/lib:/lib:/usr/lib/x86_64-linux-gnu:/usr/lib/jvm/default-java/lib/server

@IvoJJ  it seems that your cuda is not available or not in the path. Pls check the following things in the shell:
# find libcuda.so.1
# first look if it is in the path
echo $LD_LIBRARY_PATH
# now search for it
sudo find /usr/ -name 'libcuda.so.*'

Depending on your system it should be something like:
/usr/lib/i386-linux-gnu/libcuda.so.1
/usr/lib/i386-linux-gnu/libcuda.so.460.91.03
/usr/lib/x86_64-linux-gnu/libcuda.so.1
/usr/lib/x86_64-linux-gnu/libcuda.so.460.91.03
/usr/local/cuda-11.0/compat
...

If you find it add it to your path
export LD_LIBRARY_PATH=/path/of/libcuda.so.1:$LD_LIBRARY_PATH

@gisma there were no returns when using
echo $LD_LIBRARY_PATH   and
sudo find /usr/ -name 'libcuda.so.*'

@jp-hecht
the installation in the warm-up R spatial was seamless and the test script did also work. I also get the right output when using
tf$constant("Hello Tensorflow")

I dont think i got a switch in my data. I use
files <- data.frame(
   img = list.files(
      file.path(envrmt$path_model_training_data_dop),
      full.names = TRUE,
      pattern = "*.png"
   ),
   mask = list.files(
      file.path(envrmt$path_model_training_data_bui),
      full.names = TRUE,
      pattern = "*.png"
   )
)

in the bui folder are the mask files (only 2 values, or black and white). Then i split:
data <- initial_split(files, prop = 0.8)

Afterwards i build training and validation dataset:
# one more parameter
batch_size = 8

training_dataset <-
   prepare_ds(
      training(data),
      train = TRUE,
      predict = FALSE,
      model_input_shape = model_input_shape,
      batch_size = batch_size
   )

validation_dataset <-
   prepare_ds(
      testing(data),
      train = FALSE,
      predict = FALSE,
      model_input_shape = model_input_shape,
      batch_size = batch_size
   )

Then my output is:
training_dataset

<MapDataset shapes: ((None, None, None, None), (None, None, None, None)), types: (tf.float32, tf.float32)>

but maybe im not seeing something.
Thanks for the help!

@gisma no i only have onboard graphics, is this a problem?

@IvoJJ nope no problem but as far as I see it from your error messages is your system looking for a valid cuda library. So please try to re-install  it with tensorflow = cpu


Add support for sql server named instance

If sql server host name contains a backslash - pointing at a named instance connection to server fails
This is because if a named instance is specified, the port number must be omitted.
This can be fixed by replacing row 90 in connections.py with this code:
if "\\" in credentials.host:
                # if there is a backslash \ in the host name the host is a sql-server named instance
                # in this case then port number has to be omitted
                con_str.append(f"SERVER={credentials.host}")
            else:
                con_str.append(f"SERVER={credentials.host},{credentials.port}")

Maybe there is a more elegant way to do it, but the above works for me :)

Thanks for the example! Have you tested this for a non-instance of SQL Server so the original functionality still works? Mind submitting a pull request?

Good suggestion, I have tested a default instance also.
I´ll submit a pull req

Solved by #51

For anyone trying to connect to a default instance: a trailing backslash seems to work. This target defined in ~/.dbt/profiles.yml works for me:
my_project:

  outputs:

    dev:
      type: sqlserver
      driver: 'SQL Server Native Client 11.0'
      host: localhost\
      database: mydatabase
      schema: dbo
      windows_login: True

  target: dev

Note that a string like  localhost\MSSQLSERVER (which is supposedly the name of the default instance) did NOT work for me. I'm running SQL Server 2016.


Texture Filter is not set to nearest by default

Your Icons right now look incredibly blurry when used in game, because the texture filter in ActionPrompt for instance is not set to "Nearest".
I would add an option that is disabled by default and can be overwritten by the user, if they use a high rez texture pack.

Sorry, but could you provide a little more information about where you see the issue?
If I install the add-on in a fresh Godot project, the texture filter in ActionPrompt is set to "Inherit".

Oh Sorry, I forgot to answer:
I have thought about it and it is probably the "correct" thing to do, even tho it causes the icons to appear blurry in most situations: The only proper fix for this would be to include a high rez icon set with the addon, but then again I have trouble figuring out how one would select the high rez or the low rez version.
Alternatively, one could use a high rez pack by default, with would always look kind of good, instead of a low rez pack, that only looks good in the context of games with pixelart aesthetic, but this is another issue.

Oh Sorry, I forgot to answer:
I have thought about it and it is probably the "correct" thing to do, even tho it causes the icons to appear blurry in most situations: The only proper fix for this would be to include a high rez icon set with the addon, but then again I have trouble figuring out how one would select the high rez or the low rez version.
Alternatively, one could use a high rez pack by default, with would always look kind of good, instead of a low rez pack, that only looks good in the context of games with pixelart aesthetic, but this is another issue.

Thanks for getting back to me about this.
I see where you're coming from.  I initially developed this plugin for myself, and I didn't see the issue because I primarily work on pixel art games.
I've recently learned how to add configuration options to the ProjectSettings, so I'll look into adding a few different icon styles into the add-on.  Since Godot requires editing the ProjectSettings for pixel art games anyway, defaulting to high-resolution icons probably makes sense.


Crash on launching with Face ID support on iPhone X, iOS 11.4

This isn't a bug in the library, but you are now required to add a NSFaceIDUsageDescription with some string value if you support Face ID for your passcode unlock. I'm not sure if there's a way to check the plist for this value at runtime and avoid initiating Face ID if it's missing, but the docs should probably be updated and I'm leaving this here for others to reference.
To reproduce the issue:

Launch an iPhone X or iPhone X simulator on iOS 11.4 with Face ID enabled and with faces enrolled
Add a passcode to your app with biometric support enabled
Re-launch the app to trigger the passcode lock
You should get a crash at this point instead of a Face ID prompt.

Apple docs are here and suggest this has been required since iOS 11.0: https://developer.apple.com/library/archive/documentation/General/Reference/InfoPlistKeyReference/Articles/CocoaKeys.html#//apple_ref/doc/uid/TP40009251-SW75

Hey, @mgod,
Thanks for the heads-up. I consider that if you intentionally activate Face ID, you should also be aware that you need to update your Info.plist, but I will update the documentation, since that's a good idea.

Thanks @rolandleth! I really appreciate the library. It looks like it would also be fairly straightforward to check if the NSFaceIDUsageDescription string exists when the setAllowUnlockWithBiometrics method gets called with true and either log a warning message or throw an error if it's missing. Would you be interested in a PR that does either of these?
There doesn't seem to be an easy check to not use Face ID if the string is missing when it's asked for to unlock.

Glad you like it!
I'm not sure it will actually help: if a user will trigger that error and see they have to fix something, then they'd run that code anyway and crash the app; if a user doesn't reach the point where the app crashes, they wouldn't reach the point where the error is thrown, either. Me thinks.

Hmmm, true. I was more thinking that by including a logging line with a warning, you might get the attention of the developer when they're building the feature.

Aye, that would make it obvious, but that would also make it permanent, even if you took care of it/didn't implement that part 😞

True. I'll just leave a note here then for future confused developer searches that if you fail to do this you'll get  some error logging that includes something like:
 __TCCAccessRequest_block_invoke.85 + 202
 __CRASHING_DUE_TO_PRIVACY_VIOLATION__ + 706

Cool, thanks!


[R5] Create item swagger data model + add swagger annotations all 5 Item APIs

* Might need to create another swagger data model for the List Shopcart API

As a [role]
I need [function]
So that [benefit]
Details and Assumptions

[document what you know]

Acceptance Criteria
Given [some context]
When [action taken]
Then [outcome observed]

Hey team! Please add your planning poker estimate with Zenhub @emhao @LillisLuo @nijya @wl2484


"TypeError: unsupported operand type(s) for &: 'int' and 'Undefined' is prompted".

When the has_permission function in modes is called, "TypeError: unsupported operand type(s) for &: 'int' and 'Undefined' is prompted".

Any help?

Show me a full stack trace of the error please.

I solved it when I replaced the '&' in the has_permission function with 'and'，Thank you for your reply


Is there any reason to do this?

This seems like an interesting idea. I just can't think of any reason to do this for a normal web page.

@duckindustry
Thank you for your feedback!
This program was created for content to be run on tablet devices.
This is to display optional elements when there is no operation for a certain period of time on the tablet terminal installed at the venue.
This program may not be worth publishing.
However, I published it to explore and learn how various common techniques in OSS projects are applied.


[3.0][cdc-runtime] create a class implemented DebeziumDeserializationSchema.

Search before asking

[X] I searched in the issues and found nothing similar.

Motivation
We need to create a class implemented DebeziumDeserializationSchema that can convert SourceRecord to Event(include DataChangeEvent and SchemaChangeEvent).
Solution
No response
Alternatives
No response
Anything else?
No response
Are you willing to submit a PR?

[X] I'm willing to submit a PR!

closed as it's already done https://github.com/ververica/flink-cdc-connectors/blob/82ccf00e6acccb61a1dd77e65c70417e2f74856e/flink-cdc-connect/flink-cdc-source-connectors/flink-connector-debezium/src/main/java/com/ververica/cdc/debezium/event/DebeziumEventDeserializationSchema.java#L67.


vaccine availability

Vaccine availability should be tracked via state/district as well. What are your thoughts?

Thanks for the feedback.


[DOCS] update docs during paper revision

This PR will update docs for paper revision.

In this PR, docs were updated:

added instructions for: what if babs-check-setup fails or the setup is not desired - see issue #144
updated the instructions on how to use results from another BABS project


Add e2e test to confirm systemData

Which issue this PR addresses:
Fixes
What this PR does / why we need it:
Adds a test step to validate that systemData is returned from the user API, and use DisallowUnknownFields() on the admin API to verify that we are not returning unknown fields, namely systemData shouldn't be returned.
Test plan for issue:

Is there any documentation that needs to be updated for this PR?

This won't pass tests until #2695 and #2696 are merged.

/azp run ci
/azp run e2e


PAO crashes when clicking icon

Hello, I am having an issue where PAO opens just fine, but when I click the icon in game it crashes. It gives the error "A fatal error has occurred". The log file gives this error message.
"2017-01-05 11:50:49.0898|FATAL|GW2PAO.App|1|System.ArgumentException: StylusPointDescription cannot contain duplicate StylusPointPropertyInfos. Parameter name: stylusPointPropertyInfos"
I am running windows 10 professional. Any help on this issue would be appreciated, I really like the look of this overlay.

Hmm yea that's very odd. Are you running the tool on a machine with a touchscreen?

Nope no touchscreen. I do have a Wacom tablet, but I disconnected it. It does seem to be related to that doesn't it?

Here is the full message relating to that error in case it helps.
2017-01-05 11:55:54.3606|FATAL|GW2PAO.App|1|System.ArgumentException: StylusPointDescription cannot contain duplicate StylusPointPropertyInfos.
Parameter name: stylusPointPropertyInfos
at System.Windows.Input.StylusPointDescription..ctor(IEnumerable`1 stylusPointPropertyInfos)
at System.Windows.Input.TabletDeviceBase.get_StylusPointDescription()
at System.Windows.Input.StylusPointer.PointerTabletDevice.UpdateSizeDeltas()
at System.Windows.Input.StylusPointer.PointerTabletDevice..ctor(PointerTabletDeviceInfo deviceInfo)
at System.Windows.Input.StylusPointer.PointerTabletDeviceCollection.Refresh()
at System.Windows.Input.StylusPointer.PointerLogic.get_TabletDevices()
at System.Windows.Input.StylusPointer.PointerLogic.PostProcessInput(Object sender, ProcessInputEventArgs e)
at System.Windows.Input.InputManager.RaiseProcessInputEventHandlers(ProcessInputEventHandler postProcessInput, ProcessInputEventArgs processInputEventArgs)
at System.Windows.Input.InputManager.ProcessStagingArea()
at System.Windows.Input.InputManager.ProcessInput(InputEventArgs input)
at System.Windows.Input.MouseDevice.ChangeMouseCapture(IInputElement mouseCapture, IMouseInputProvider providerCapture, CaptureMode captureMode, Int32 timestamp)
at System.Windows.Input.MouseDevice.PreNotifyInput(Object sender, NotifyInputEventArgs e)
at System.Windows.Input.InputManager.ProcessStagingArea()
at System.Windows.Input.InputManager.ProcessInput(InputEventArgs input)
at System.Windows.Input.InputProviderSite.ReportInput(InputReport inputReport)
at System.Windows.Interop.HwndMouseInputProvider.ReportInput(IntPtr hwnd, InputMode mode, Int32 timestamp, RawMouseActions actions, Int32 x, Int32 y, Int32 wheel)
at System.Windows.Interop.HwndMouseInputProvider.FilterMessage(IntPtr hwnd, WindowMessage msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at System.Windows.Interop.HwndSource.InputFilterMessage(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at MS.Win32.HwndWrapper.WndProc(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at MS.Win32.HwndSubclass.DispatcherCallbackOperation(Object o)
at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)
at System.Windows.Threading.Dispatcher.LegacyInvokeImpl(DispatcherPriority priority, TimeSpan timeout, Delegate method, Object args, Int32 numArgs)
at MS.Win32.HwndSubclass.SubclassWndProc(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam)

Hey sorry to spam you, I'm sure you are quite busy. Just wanted to let you know I resolved my problem by uninstalling the drivers for my drawing tablet and restarting, so it does appear to be related to that. I rarely use it so I don't mind, but just thought I would let you know the root of the problem in case others experience it in the future.

Ok thanks for the update! Definitely an odd one, and based on the limited searching I did on the exception text, it might have been an issue that would impact other applications on your machine as well.


added conda-forge as preferred package channel

Added two lines in environment.yml file to indicate conda-forge is the preferred package channel for creating the saul environment.

Perfect, thanks @shelbyahrendt!


Sending information to React Native level from the service

Hi, in your article you did something like this:
public class HeartbeatService extends Service {
   …
   private Handler handler = new Handler();
   private Runnable runnableCode = new Runnable() {
     @Override
     public void run() {
       context.getJSModule(DeviceEventManagerModule.RCTDeviceEventEmitter.class).emit("Heartbeat",null);
       handler.postDelayed(this, 2000);
     }
   };
   …
}

But the context you use, here is service context and it doesn't have getJSModule() method. So how does it work for you? I get an error complaining that this method doesn't exist on this context. Can you please explain how does it work for you?

@edwardkes did you get any solution?

@uplsoumen Sorry for replying so late. But I have indeed...
You can get the React context like that:
ReactApplication application = (ReactApplication)(context.getApplicationContext());
ReactContext reactContext = application.getReactNativeHost()
                .getReactInstanceManager()
                .getCurrentReactContext();

If the context is null, than you can request it like that:
 ReactApplication application = (ReactApplication)(context.getApplicationContext());
  application
                .getReactNativeHost()
                .getReactInstanceManager()
                .addReactInstanceEventListener(new ReactInstanceManager.ReactInstanceEventListener() {
                    @Override
                    public void onReactContextInitialized(ReactContext context) {
                        Log.i(TAG, "onReactContextInitialized: received new react context");

                    }
                });
            application.getReactNativeHost()
                    .getReactInstanceManager()
                    .createReactContextInBackground();

@edwardkes
Androidstudio gives me an error: Cannot resolve symbol 'context'
how do you solve it?


Consumer can't receive message from topic

Describe the bug
pulsar v2.8.1
Use the producer asynchronous sending interface to write data to the topic.
In broker.conf, acknowledsegmentatbatchindexlevelenabled = true. When creating a consumer, set enablebackindexacknowledgesegment (true).
After the consumer has been running for a period of time, it can‘t receive message, but there is actually a lot of backlog in subscription.

To Reproduce
Steps to reproduce the behavior:
1.producer code:
           Producer<NlMessage> producer = client.newProducer(Schema.JSON(NlMessage.class))
                    .topic(topic)
                    .producerName(producerName + "-" + UUID.randomUUID().toString())
                    .blockIfQueueFull(true)
                    .sendTimeout(0, TimeUnit.SECONDS)
                    .create();

Consumer used retry and dead letter topic.
consumer code:
        ConsumerBuilder<NlMessage> consumerBuilder = consumerBuilder.topic(consumerParam.getTopic())
                .subscriptionName(consumerParam.getSubscription())
                .subscriptionType(subscriptionType)
                .enableRetry(consumerParam.isEnableRetry())
                .enableBatchIndexAcknowledgment(true)
                .subscriptionInitialPosition(SubscriptionInitialPosition.Earliest);
        // DLQ
        consumerBuilder.deadLetterPolicy(consumerParam.getDeadLetterPolicy());
        // 需要在死信策略设置以后 再设置ackTimeout (如果ackTimeout == 0)
        consumerBuilder.ackTimeout(0, TimeUnit.SECONDS);

        Consumer<NlMessage> consumer = consumerBuilder.subscribe();
        while (true) {
             Message<NlMessage> message = consumer.receive();
             // doBiz
             int ret = doBiz(message);
             if (ret == 0) {
                 consumer.acknowledge(message);
             } else if(ret == 1) {
                 consumer.negativeAcknowledge(message);
             } else if (ret == 2) {
                 consumer.reconsumeLater(msg, 10, TimeUnit.SECONDS);
             }
        }

Start producer and consumer
After running for a period of time, the consumer can't receive the message. The consumer has done the negative knowledge operation.
No error in broker.log
jstack consumer pid

Thanks for providing the information, we will try to reproduce it first.

@codelipenghui
I want try to work on it together, if possible  :)

@codelipenghui @Technoboy- I want try to work on it together, if possible :)

Yes, you can if you have time.

@xuesongxs Could you send me an email for instant communication?  I didn't reproduce this issue .

@xuesongxs Could you send me an email for instant communication? I didn't reproduce this issue .

wechat: daxia_xue


[Multi Actions] Test test test with new actions before moving forward

Some fair amount of testing happened


Create mermaid diagram for Substrate Node

This PR creates a mermaid diagram for Substrate Node architecture. It demonstrates the separation between the runtime and the client.
@nhussein11 I got this laid out ok but I'm not having luck applying styles. I was hoping to make the "Substrate Node" text a size bigger and maybe bold? idk. Just doesn't stand out much. Do you want to take a shot at applying styles?

@nhussein11 I got this laid out ok but I'm not having luck applying styles. I was hoping to make the "Substrate Node" text a size bigger and maybe bold? idk. Just doesn't stand out much. Do you want to take a shot at applying styles?

@dawnkelly09 Definitely! I can take a shot at the styles once Luca's comments are addressed :)


Memos container failing to start due to database migration issues.

Describe the bug
I am running Memos via Portainer on Synology NAS with PostgreSQL database based on the docker compose found here : https://mariushosting.com/how-to-install-memos-with-postgresql-on-your-synology-nas/ . Following the image upgrade to v0.22.5, the containter no longer starts due to what appears to be database migration issues. I have also done a full, clean reinstall via docker compose and the problem persists.  I have included the docker compose file and container log file for info. I am pretty sure this issue has arisen since v0.22.5 - I had no problems before.
Steps to reproduce
Docker Compose File:
version: "3.9"
services:
db:
image: postgres:16
container_name: Memos-DB
hostname: memos-db
mem_limit: 512m
cpu_shares: 768
security_opt:
- no-new-privileges:true
healthcheck:
test: ["CMD", "pg_isready", "-q", "-d", "memos", "-U", "memosuser"]
timeout: 45s
interval: 10s
retries: 10
volumes:
- /volume1/docker/memos/db:/var/lib/postgresql/data:rw
environment:
POSTGRES_DB: memos
POSTGRES_USER: memosuser
POSTGRES_PASSWORD: memospass
restart: on-failure:5
memos:
image: ghcr.io/usememos/memos:stable
container_name: Memos
hostname: memos
security_opt:
- no-new-privileges:true
healthcheck:
test: wget --no-verbose --tries=1 --spider http://localhost:5230/
user: 1026:100
ports:
- 5240:5230
environment:
MEMOS_DRIVER: postgres
MEMOS_DSN: 'postgresql://memosuser:memospass@memos-db:5432/memos?sslmode=disable'
volumes:
- /volume1/docker/memos/data:/var/opt/memos:rw
restart: on-failure:5
depends_on:
db:
condition: service_healthy
Container Log File:
The files belonging to this database system will be owned by user "postgres".
This user must also own the server process.
The database cluster will be initialized with locale "en_US.utf8".
The default database encoding has accordingly been set to "UTF8".
The default text search configuration will be set to "english".
Data page checksums are disabled.
fixing permissions on existing directory /var/lib/postgresql/data ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
initdb: warning: enabling "trust" authentication for local connections
initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.
syncing data to disk ... ok
Success. You can now start the database server using:
pg_ctl -D /var/lib/postgresql/data -l logfile start
waiting for server to start....2024-10-13 13:17:57.735 UTC [49] LOG:  starting PostgreSQL 16.4 (Debian 16.4-1.pgdg120+2) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
2024-10-13 13:17:57.737 UTC [49] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2024-10-13 13:17:57.780 UTC [52] LOG:  database system was shut down at 2024-10-13 13:17:56 UTC
2024-10-13 13:17:57.799 UTC [49] LOG:  database system is ready to accept connections
done
server started
CREATE DATABASE
/usr/local/bin/docker-entrypoint.sh: ignoring /docker-entrypoint-initdb.d/*
2024-10-13 13:17:58.557 UTC [49] LOG:  received fast shutdown request
waiting for server to shut down....2024-10-13 13:17:58.559 UTC [49] LOG:  aborting any active transactions
2024-10-13 13:17:58.561 UTC [49] LOG:  background worker "logical replication launcher" (PID 55) exited with exit code 1
2024-10-13 13:17:58.563 UTC [50] LOG:  shutting down
2024-10-13 13:17:58.577 UTC [50] LOG:  checkpoint starting: shutdown immediate
.2024-10-13 13:18:00.249 UTC [50] LOG:  checkpoint complete: wrote 922 buffers (5.6%); 0 WAL file(s) added, 0 removed, 0 recycled; write=0.324 s, sync=1.156 s, total=1.686 s; sync files=301, longest=0.108 s, average=0.004 s; distance=4255 kB, estimate=4255 kB; lsn=0/1912100, redo lsn=0/1912100
2024-10-13 13:18:00.256 UTC [49] LOG:  database system is shut down
done
server stopped
PostgreSQL init process complete; ready for start up.
2024-10-13 13:18:01.015 UTC [1] LOG:  starting PostgreSQL 16.4 (Debian 16.4-1.pgdg120+2) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14) 12.2.0, 64-bit
2024-10-13 13:18:01.076 UTC [1] LOG:  listening on IPv4 address "<IP_ADDRESS>", port 5432
2024-10-13 13:18:01.076 UTC [1] LOG:  listening on IPv6 address "::", port 5432
2024-10-13 13:18:01.461 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2024-10-13 13:18:01.506 UTC [65] LOG:  database system was shut down at 2024-10-13 13:18:00 UTC
2024-10-13 13:18:01.786 UTC [1] LOG:  database system is ready to accept connections
2024-10-13 13:18:07.127 UTC [76] ERROR:  relation "migration_history" does not exist at character 33
2024-10-13 13:18:07.127 UTC [76] STATEMENT:  SELECT version, created_ts FROM migration_history ORDER BY created_ts DESC
2024-10-13 13:23:01.608 UTC [63] LOG:  checkpoint starting: time
2024-10-13 13:23:17.217 UTC [63] LOG:  checkpoint complete: wrote 156 buffers (1.0%); 0 WAL file(s) added, 0 removed, 0 recycled; write=15.356 s, sync=0.035 s, total=15.610 s; sync files=119, longest=0.005 s, average=0.001 s; distance=805 kB, estimate=805 kB; lsn=0/19DB5C0, redo lsn=0/19DB588
The version of Memos you're using.
v.0.22.5
Screenshots or additional context
No response

Related to: https://github.com/usememos/memos/pull/3873
to solve this just change the following line in the compose:
ghcr.io/usememos/memos:stable
with
ghcr.io/usememos/memos:latest

Related to: https://github.com/usememos/memos/pull/3873
to solve this just change the following line in the compose:
ghcr.io/usememos/memos:stable
with
ghcr.io/usememos/memos:latest

Thank you @mariushosting


Describe how to configure a staging environment

Trying to set up a staging environment from a successfully deployed main branch fails with the following error:

This branch currently does not contain workflow configuration files.
You will have to rebase or merge the configuration manually from another branch.

I have no idea, though, which configuration to rebase or merge. The files are - so far - exactly the same in the stagingOne branch.

Best
Chris

Hey Chris,
thanks for the quick reply but have you found anything out by now?
Or do you need more information?
Cheers and happy new year!

After reviewing some details, it seems you were able to resolve the issue and deploy your projects successfully. If you need any further assistance, please don't hesitate to reach out via email at<EMAIL_ADDRESS>


registerRestInterface and registerWebInterface should return the router

So that the functions become chainable just like get/post/any and such.

Still not sure if method chaining is a good paradigm in D, considering the existence of with, but since we already have it in other places, I'd agree that it improves consistency. I'd just not want to advertise it as the standard way to access the API in the examples, maybe as a commented-out alternative right after the usual stand-alone UFCS call.

updated

Thanks!


KAFKA-17092: Revisit KafkaConsumerTest#testBeginningOffsetsTimeout for AsyncConsumer

https://issues.apache.org/jira/browse/KAFKA-17092
The root cause is AsyncConsumer will send FIND_COORDINATOR request first. If we are lucky today and the prepared responses are ready before handling the FIND_COORDINATOR request, the mock time can get advanced to trigger the timeout exception.
Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

@m1a2st Thanks for this patch. I know this patch is based on my comments on the jira. However, this patch can has a side effect: the mock time can get advanced even though the response is consumed by non-LIST_OFFSET request. That is not the case we want to verify. The story should have following chapters:

the LIST_OFFSET gets response but the response carries error ( it proves RPC is good)
the incomplete request can get timeout

WDYT?

It's a good idea, I will do that


Rearchitect

Rearchitect UTD Grades...

Migrate all JavaScript to TypeScript.
Completely rework conversion and import scripts. The process now produces a single sqlite database file
Eliminate the backend, making UTD Grades a fully static site. The sqlite database is pushed to the client and queries are done entirely in the browser.

Maybe we should pull this into a new branch, and run a separate deployment off of that.
With both deployments running simultaneously, migration is as easy as a DNS change. This should result in less downtime during migration to the new site, and faster rollback in case that fails.


[icons] Icon in download list are shown twice.

Description: Icon in download list (general document) are shown twice.
Link: http://swiss.github.io/styleguide/content_modules_-_functions.html
Browser: IE9
For further information or if you have any questions please do not hesitate to contact me<EMAIL_ADDRESS>Screenshot:

Reviewed and closed


Provide a shortcut to close a commenting widget after adding a comment

Issue Type: Bug
When reviewing code I usually only add a single comment to a line. I'd like to have a keyboard shortcut that I can use to commit the comment and close the commenting widget at the same time.
Extension version: 1.14.0
VS Code version: Code - Insiders 1.31.0-insider (b4fc71b972eae2425d39ac4041df0c36cfa1bb37, 2019-01-15T06:12:40.322Z)
OS version: Darwin x64 18.0.0

Did you manage to find a solution to this?


Update @balena/jellyfish-jellyscript from 5.2.1 to 5.2.2

Change-type: patch
Signed-off-by: Josh Bowling<EMAIL_ADDRESS>

@balena-ci I self certify!


[EventRequest] SalesStats.Page.al (page 10042 "Sales Stats.")

Hi MS,
Please help us in migrating our verticalized solution by adding below Event in SalesStats.Page.al Page.
Standard Code

Modified Code

Event Signature

Thanks
SUD

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. We will update this issue with information about availability.


Accept session resumption IDs

With the https module I could do this to accept the session resumption IDs that are automatically set:
var sslSessionCache = {};
server.on('newSession', function(sessionId, sessionData, callback) {
	sslSessionCache[sessionId] = sessionData;
	callback();
});
server.on('resumeSession', function (sessionId, callback) {
	callback(null, sslSessionCache[sessionId]);
});

This module also sets IDs but doesn't seem to accept them. Is there a way to make this work? I would prefer to have it fire the same events as the https module.

Yes, it would be good to enable session resumption with h2. Putting this in the backlog.


projects(Backend,CCIProvider,Model) missed

Sorry about that! Those projects actually come from a different repo. I've updated the README.md to give instructions on where to find that repo and how to map it to your enlistment. Let me know if that doesn't work.


Can't  switch code from "JAVASCRIPT" to "BLOCKS" on IE

Repro steps:
• Navigate to https://makecode.adafruit.com/ on IE
• Click "PROJECT" -> "EXAMPLES" -> "Blinky"
• Click "BLOCKS"
Expect result:
Project "Blinky" can switch from "JAVASCRIPT" to "BLOCKS"
Actual result:
Project "Blinky" can't switch from "JAVASCRIPT" to "BLOCKS"
(Project "power glove" and "Level" can't switch from "JAVASCRIPT" to "BLOCKS")

This is a good find. Thanks @Helen09. @microsoftsam please prioritize.

I believe this is another sideeffect of #2244

which I fixed last night https://github.com/Microsoft/pxt-adafruit/commit/7f15423f941e24f951956e103f8d6e09b141db6b

Verified this has been fixed by my fix.

Awesome thanks!


update(gvisor): add retries and ignore_setup_error to gvisor config g…

…eneration
Signed-off-by: Lorenzo Susini<EMAIL_ADDRESS>
What type of PR is this?

Uncomment one (or more) /kind <> lines:

/kind bug

/kind cleanup

/kind design

/kind documentation

/kind failing-test

/kind feature
Any specific area of the project related to this PR?

Uncomment one (or more) /area <> lines:

/area build

/area driver-kmod

/area driver-bpf

/area driver-modern-bpf

/area libscap-engine-bpf

/area libscap-engine-gvisor

/area libscap-engine-kmod

/area libscap-engine-modern-bpf

/area libscap-engine-nodriver

/area libscap-engine-noop

/area libscap-engine-source-plugin

/area libscap-engine-udig

/area libscap

/area libpman

/area libsinsp

/area tests

/area proposals

What this PR does / why we need it:
Add ignore_setup_error and retries to gVisor configuration.
ignore_setup_error is useful to let pods start even if Falco is not running. This is perfectly ok since Falco has the logic to connect to running sandboxes.
On the other hand, retries is the number of times gVisor will try to send again the message in case the buffer is full and Falco can't keep up with it.
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

NONE

Hi @loresuso. Thanks for your PR.
I'm waiting for a falcosecurity member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.
Once the patch is verified, the new status will be reflected by the ok-to-test label.
I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: loresuso
To complete the pull request process, please assign leodido after the PR has been reviewed.
You can assign the PR to them by writing /assign @leodido in a comment when ready.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

/ok-to-test

LGTM label has been added.  Git tree hash: 139f7c25081f3ed07bcd4f44a915d2205f29644f


chore(main): release xcm-analyser 1.3.0

:robot: I have created a release beep boop
1.3.0 (2024-07-04)
Features

xcm-api: Add XCM Analyser endpoint (d171645)

Miscellaneous Chores

Update Node.js to v20 LTS (4b00caa)
Update SDK dependencies ⚙ (281d5c7)

Code Refactoring

Upgrade ESlint to v9 & create shared config (524161b)

This PR was generated with Release Please. See documentation.

:robot: Created releases:

xcm-analyser-v1.3.0
:sunflower:


[tf.keras] Mixed precision policy "mixed_bfloat16" not supported in Keras compile

System information

Have I written custom code: Yes
OS Platform and Distribution: Co-lab
TensorFlow installed from (source or binary): binary
TensorFlow version (use command below): TF 2.1-rc0
Python version: 3.6

Describe the current behavior
We are porting a GPU based model to CloudTPU. We are using Keras mixed_float16 mixed-precision policy to enable TensorCore on GPU. Without any code change, we are trying to use mixed_bfloat16 for CloudTPU for maximal performance.
Describe the expected behavior
model.compile with mixed_bfloat16 policy to enable mixed-precision training on CloudTPU.
Code to reproduce the issue
Colab link: https://colab.research.google.com/drive/1-SBnqhsmyjVNJxntB8ZZdqRUk7h7tRs8
def compile_keras_model(dtype):
  policy = tf.keras.mixed_precision.experimental.Policy(dtype)
  tf.compat.v2.keras.mixed_precision.experimental.set_policy(policy)

  optimizer = tf.optimizers.SGD(learning_rate=0.1, momentum=0.9)

  model = tf.keras.applications.resnet50.ResNet50(weights=None)
  model.compile(loss='sparse_categorical_crossentropy',
                optimizer=optimizer,
                metrics=['sparse_categorical_accuracy'])
  return model

gpu_model = compile_keras_model('mixed_float16')
tpu_model = compile_keras_model('mixed_bfloat16')

Other info / logs
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-5-ad9cf91bd793> in <module>()
     12
     13 gpu_model = compile_keras_model('mixed_float16')
---> 14 tpu_model = compile_keras_model('mixed_bfloat16')

12 frames
/usr/local/lib/python3.6/dist-packages/tensorflow_core/python/framework/op_def_library.py in _SatisfiesTypeConstraint(dtype, attr_def, param_name)
     59           "allowed values: %s" %
     60           (param_name, dtypes.as_dtype(dtype).name,
---> 61            ", ".join(dtypes.as_dtype(x).name for x in allowed_list)))
     62
     63

TypeError: Value passed to parameter 'x' has DataType bfloat16 not in list of allowed values: float16, float32, float64, complex64, complex128

I have tried on colab with TF version 2.1.0-rc0 and was able to reproduce the issue.Please, find the gist here. Thanks!

Gently ping @reedwm; is this behavior intended?

The issue is that we are calling an op that does not support bfloat16 in the Loss. We should do all Losses in float32, but I haven't implemented that yet. I regret not doing this for 2.1, but this will definitely be fixed in 2.2.
Because of this issue, in 2.1, models should end in float32. For models which you cannot modify, like tf.keras.applications.resnet50.ResNet50, you can wrap the model with a version that has a float32 output, as follows:
def compile_keras_model(dtype):
  policy = tf.keras.mixed_precision.experimental.Policy(dtype)
  tf.compat.v2.keras.mixed_precision.experimental.set_policy(policy)

  optimizer = tf.optimizers.SGD(learning_rate=0.1, momentum=0.9)

  model = tf.keras.applications.resnet50.ResNet50(weights=None)

  # Create new model that is `model` except the output is float32
  inp = tf.keras.layers.Input(batch_shape=model.input_shape)
  out = model(inp)
  # This layer simply casts to float32
  out = tf.keras.layers.Activation('linear', dtype='float32')(out)
  model = tf.keras.Model(inp, out)

  model.compile(loss='sparse_categorical_crossentropy',
                optimizer=optimizer,
                metrics=['sparse_categorical_accuracy'])
  return model

gpu_model = compile_keras_model('mixed_float16')
tpu_model = compile_keras_model('mixed_bfloat16')

Additionally, if your model ends in softmax, you should also do the softmax in float32, as a few models require this for numeric stability and it has very little impact on performance. Only softmaxes at the end of the model need to be float32; if a softmax is in the middle of the model, doing it in float16 is fine. For example, if your model ends with the following
out = tf.keras.layers.Dense(32, activation='softmax')(out)

Replace it with the following:
out = tf.keras.layers.Dense(32)(out)
out = tf.keras.layers.Activation('softmax', dtype='float32')(out)

This will cause the softmax to be in float32, and the output of the model in float32.
Unfortunately, none of the keras application models currently do the last softmax in float32, but I will fix in a future release. If feasible, I will try to have this done automatically. Luckily, for most models, including resnet50, doing the softmax at the end of the model in float16 is fine

@reedwm that’s very helpful, thanks Reed!
I’ll leave this issue as a marker and close it once it’s fixed in master.

@byronyi Looks like this was already implemented in the recent tf-nightly. Please check the gist here. Thanks.
Please close the issue if this was resolved for you. Thanks!

Ah yeah, this was fixed fairly recently.
It turns out doing softmax + loss in fp16 or bf16 is fine in most cases. For this particular issue, the error came from the div_no_nan op, which Keras will now always do in fp32 to avoid the error.


NodeMCU v3 (LOLIn) doesn't work with W5500

I connected the W5500 to NodeMCU v3 (LoLin) via SPI (D5, D6, D7, D8), but NodeMCU v3 does not run the code. This happens when the CS W5500 pin is connected to the D8 W5500 pin. I tried to connect SY to another pin on NodeMCU m3 and reassigned pennies in the code using Wiznet5500lwIP eth(CS PING), NodeMCU v3 runs the code, but W5500 itself does not detect.

After int present = eth.begin(mac); controller reload

I use static IP, mask, gateway, dns...
eth.config(ip, gateway, subnet, dns_1, dns_2);

This happens when the CS W5500 pin is connected to the D8 W5500 pin.

D8(=GPIO15) is boot starp.
If you connect to this, You don't burn fairmware.


Open script file

Hi , I have an issue with Visual studio code.
I am currently set as default text editor. However, when I double click on the file it show me the welcome page without showing me the requested file. It reqiure me to close it again and use the right click -> open with Win Code t open the file.
Any help to make open by double click on the file only? :)
btw, thaks for the software. it is really goooooood
Best Regards,
Abdulla Aldoseri

VSCode Version: Code 1.9.0 (27240e71ef390bf2d66307e677c2a333cebf75af, 2017-02-02T08:31:00.827Z)
OS Version: Windows_NT ia32 10.0.14393
Extensions:

Extension
Author
Version

html-snippets
abusaidm
0.0.18

Angular2
johnpapa
1.0.2

cpptools
ms-vscode
0.10.0

debugger-for-chrome
msjsdiag
2.5.2

JavaScriptSnippets
xabikos
1.2.0

Related #20088


fix agendaHeaderFormat in Calendar

The documentation is showing the wrong information for agendaHeaderFormat -- it is dateRangeFormat not dateFormat. I tracked it down to it being set wrong in src/Calendar.js.

thanks!


[Gally]: master <- dev

Automatically created by Git-Ally

:tada: This PR is included in version 3.0.56 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Workshop creation WMS ID 11462

WMS ID 11462
General requirements

Information in the workshop is adequate and updated
Code is correct and working
Links are correct
Make sure you enter the help email link in your manifest.json
Please make sure WMS URLs are updated as needed after your PR is approved

Checklist - Refer to the QA document for the complete list
Please confirm that the following is completed before submitting your PR

[ ] All filenames are lower case (including folders, images, files, etc.)
[ ] Filenames are descriptive
[ ] Your workshop folder structure should be similar to the one used in the sample workshop (https://github.com/oracle-livelabs/common/tree/main/sample-livelabs-templates/sample-workshop)
[ ] Are you using multiple versions (desktop/, sandbox/, tenancy/)? Make sure that each of them contains a manifest.json and an index.html
[ ] Image references in markdown contain an alternate text

@eliana-romero - In preparation for Oracle CloudWorld there is a GitHub freeze in place. We will only accept emergency PRs upon sending an email to<EMAIL_ADDRESS>including justification. If this is not urgent, please close this PR and create a new PR after the Oracle Cloudworld event.

@eliana-romero - Closing this PR for now. Please create a new PR after the OCW event.


The bfrt_python cli of install/bin/bfswitchd

We desire to run the bfrt_python CLI through install/bin/bfswitchd. However, the error occurs:
Traceback (most recent call last):
File "/sde/install/lib/python3.8/bfrtcli.py", line 17, in
from traitlets.config import Config
File "/sde/install/lib/python3.8/site-packages/traitlets/config/init.py", line 6, in
from .application import *
File "/sde/install/lib/python3.8/site-packages/traitlets/config/application.py", line 18, in
from traitlets.config.configurable import Configurable, SingletonConfigurable
File "/sde/install/lib/python3.8/site-packages/traitlets/config/configurable.py", line 11, in
from .loader import Config, LazyConfigValue, DeferredConfig, _is_section_key
File "/sde/install/lib/python3.8/site-packages/traitlets/config/loader.py", line 16, in
from ipython_genutils.path import filefind
File "/sde/install/lib/python3.8/site-packages/ipython_genutils/path.py", line 13, in
import random
File "/sde/install/lib/python3.8/random.py", line 40, in
from cgi import print_form
File "/sde/install/lib/python3.8/cgi.py", line 39, in
from email.parser import FeedParser
File "/sde/install/lib/python3.8/email/parser.py", line 12, in
from email.feedparser import FeedParser, BytesFeedParser
File "/sde/install/lib/python3.8/email/feedparser.py", line 27, in
from email._policybase import compat32
File "/sde/install/lib/python3.8/email/_policybase.py", line 7, in
from email import header
File "/sde/install/lib/python3.8/email/header.py", line 14, in
import binascii
ModuleNotFoundError: No module named 'binascii'
Failed to load bfrtcli python library
bfrt_cli_cmd:201 could not initialize bf_rt for the cli. err: 1
We print the sys.path by hacking the bfrtcli.py and shows that:
bfshell> bfrt_python
['/sde/install/lib/python38.zip', '/sde/install/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/sde/install/lib/python3.8/site-packages']
We use the interactive interface of python3.8 and import the module named 'binascii'. It successes.  At the interactive interface, the sys.path is shown as followed:

sys.path
['', '/sde/install/lib/python38.zip', '/sde/install/lib/python3.8', '/sde/install/lib/python3.8/lib-dynload', '/sde/install/lib/python3.8/site-packages']

The environment is wrong. I used a clear environment and solved it.


Can we align the structured logs fields with ECS

https://www.elastic.co/guide/en/ecs/current/ecs-getting-started.html

Do you mean these fields: https://github.com/qudini/qudini-reactive/tree/master/qudini-reactive-logging#json-structured-logging? If yes, what makes then not aligned with ECS exactly?

sorry the link has changed https://www.elastic.co/guide/en/ecs/1.12/index.html
The field names do not match with ECS but Let's hold off on this one since I am not sure about that anymore


Enable running 'update-cdk' tasks for multiple regions

This is a pull request for the issue discussed on Slack.
Current behavior:
At the moment the update-cdk plugin sets the environment variables CDK_DEFAULT_REGION and CDK_DEFAULT_ACCOUNT. However, the CDK CLI overwrites these variables using the same account/region resolution strategie as the AWS CLI. This means that the CDK workload cannot determine the correct region if the region is different from the region in which the org-formation tasks are executed.
Desired behavior:
The CDK workload should be able to determine the correct region and account for deployment.
Solution
Add CDK_DEPLOY_ACCOUNT and CDK_DEPLOY_REGION to environment variables for update-cdk tasks as suggested in the AWS CDK documentation. The CDK workload can the use these environment variables like this:
#!/usr/bin/env node
import { App } from '@aws-cdk/core';
import { MyStack } from './my-stack.ts';

const app = new App();

new MyStack(app, 'MyStack', {
    env: {
        account: process.env.CDK_DEPLOY_ACCOUNT || process.env.CDK_DEFAULT_ACCOUNT,
        region: process.env.CDK_DEPLOY_REGION || process.env.CDK_DEFAULT_REGION,
    },
});

nice, LGTM. will make sure i verify the integration test succeeds, code review and merge this.
thanks


Updates github actions

Will be using this PR to test modifications to CI

Managed to cut down the time involved with preparing the remote build system. Dependencies install in less than 30s now and nothing breaks, so seems like this is good. @iwanlevin perhaps you could perform the review?

I decided to rebase the branch to remove things related to the libraries PR.  Now it should make sense to merge to develop.


Remove references to nprapps

Changes

Replace 'nprapps' with 'inn' in a bunch of places
Update the Google Analytics default ticket so it doesn't look like something we don't need to do.

Why
PR from benlk/app-template because I'm not on the INN/app-template repo.

weird. just added the tech team group so that should be all set now


Failed to check UMM state. Make sure UMM is installed & launch WOTR once

I tried to run ModFinder but got this error message instead "Failed to check UMM state. Make sure UMM is installed & launch WOTR once"
Dunno if this affects the ModFinder, but when I start UMM 0.31.1 ally my installed mods are not listed except for 1 SpeechMod, the status is blank; if I click "Check updates" it just gets stuck on "Checking mod updates"
Log.txt

As said on Discord, it appears your UMM isn't installed correctly, and that clicking the Uninstall and then Install button in the UMM installer would fix your issue.


Warn when user uses dependency insight on legacy configuration

Context
See https://discuss.gradle.org/t/unable-to-figure-out-how-a-transitive-dependency-of-a-particular-version-is-ending-up-in-my-jar/34117 : it's not uncommon for people to use dependencyInsight --configuration compile, which doesn't make sense.
If they do, we should warn them and tell them: "You used compile but what you want is more likely compileClasspath or runtimeClasspath".

This is obsolete and has been fixed.
Dependency insight will fail when invoked on a non-resolvable configuration.
Will close as soon as I figure out which Gradle version solved this.


0.4.0

Im going to release next 0.4.0 version. There are a lot of changes and improvements, and breaking changes too. Last breaking change I made today - I've changed ValidationError signature. Before releasing I wanted to ask you guys @zakhenry @DominicBoettger if there is something you think is wrong in this release, or something should be added/changed before this release.
Thank you

Looks good to me, the upgrade for me to 0.4.0 was relatively straight forward, only complexity was in dealing with the new container

From memory the difference was that now everything is retrieved from the container (previously just instantiated), and I was providing my own container, but it had no reference to Validator for example. So  I had to extend my container to fall back to instantiation.

The only way to make that simpler would be do do the following:
Change
export function useContainer(iocContainer: { get(someClass: any): any }) {
    container = iocContainer;
}

To
export function useContainer(iocContainer: { get(someClass: any): any }) {
    const originalContainer = container;
    container = {
        get: (someClass: any) => {
            try {
                return iocContainer.get(someClass);
            } catch () {
                return originalContainer.get(someClass);
            }
        }
    }
}

(The above is a crude proof of concept to demonstract the point, it should be a cleaner implementation where the original container is a class that can have a container passed to it to try first)

Actually you could probably use my implementation directly:
interface InjectableClass<T> {
    new (...args: any[]): T
}

interface IOCContainer {
    get(someClass: any): any
}

class Container implements IOCContainer {

    protected externalInjector: IOCContainer;

    protected instances: WeakMap<InjectableClass<any>, any> = new WeakMap();

    /**
     * Get the instance of a class when there is no dependency
     * @param staticClass
     * @returns {any}
     */
    public noDependencyGet<T>(staticClass: InjectableClass<T>): T {

        if (!this.instances.has(staticClass)) {
            this.instances.set(staticClass, new staticClass());
        }

        return this.instances.get(staticClass);
    }

    public get<T>(staticClass: InjectableClass<T>): T {
        try {
            if (!this.injector) {
                return this.noDependencyGet(staticClass);
            }

            return this.injector.get(staticClass);
        } catch (e) {
            return this.noDependencyGet(staticClass);
        }
    }

    public setContainer(iocContainer: IOCContainer): this {
        this.externalInjector = iocContainer;
        return this;
    }
}

as I understood, your container cannot simply return instance of the class it received, thats why fallback to original container is required. But I thought most containers working like this: you send them refrenece to the class / token and they return you instance of this class, without complaining

Yep thats the problem, I guess not all containers do that - I'm just using the Angular 2 injector, so probably a fairly common use case

I guess it will not give you instance of the class, until you explicitly "provide" it?

Correct, and providing tokens is done when the injector instance is created.
For example:
import { ReflectiveInjector } from  '@angular/core';
const providers = ReflectiveInjector.resolve([
    {provide: Validator, useClass: MyValidator}
]);
const injector  = ReflectiveInjector.fromResolvedProviders(providers);

got it.
the reason why angular's container works differently then others, I think mostly because it was designed to work with tree-like components. And this design works fine with tree-like components when you can provide any instance on any level of the tree - I like this concept when designing view components

Yea, also the Angular container can handle hierarchical dependencies - the injected class can be dependent on other injected classes.
I actually have a unit test showing this working with a custom validator having external dependencies, see https://github.com/ubiquits/ubiquits/blob/master/src/common/stores/store.spec.ts#L16-71

so, about fallback, probably I need not only catch an exceptions, but also check for null/undefined references?
get: (someClass: any) => {
            try {
               const instance = iocContainer.get(someClass);
               if (instance)
                   return instance;
            } catch (error) {
            }
            return originalContainer.get(someClass);
        }

and what shall I do with error? is it a really good to catch errors and completely ignore them? can be a situation when there is some another error, that you user should be aware of?

Yea thats probably a good idea to check if defined. Good point on the error, maybe if a setContainerFallbackCondition((error:Error):boolean):this could be added?
try {
    const instance = iocContainer.get(someClass);
    if (instance) {
        return instance;
    }
} catch (error) {
    if (this.containerFallbackCondition && !setContainerFallbackCondition(error)) {
        throw error;
    }
}
return originalContainer.get(someClass);

this makes it complicated, I think this kind of logic should be resolved on client side. Maybe something simple like this:
useContainer(container, { fallback: true, fallbackOnErrors: true });

interface UseContainerOptions {

    /**
     * If set to true, then default container will be used in the case if given container haven't returned anything.
     */
    fallback?: boolean;

    /**
     * If set to true, then default container will be used in the case if given container thrown an exception.
     */
    fallbackOnErrors?: boolean;

}

Maybe if fallbackOnErrors could be fallbackOnErrors?: boolean | (error:Error):boolean ? Best of both worlds?

Actually I don't understand what the behaviour would be with
useContainer(container, { fallback: true, fallbackOnErrors: false });

?

It will be same as
 const instance = iocContainer.get(someClass);
    if (instance) {
        return instance;
    }

e.g. without try/catch. Without fallback: true it will work like now, .e.g without any fallback at all.

Maybe if fallbackOnErrors could be fallbackOnErrors?: boolean | (error:Error):boolean ? Best of both worlds?
I think it overcomplicates it - "handing error based on some function that returns true or false for this error" - seems very specific feature, and if needed user should handle it by themself, by passing a custom container that handle it.

Yea sorry I misread the comments in the interface, understood now

here is how it will look like: #20

released https://github.com/pleerock/class-validator/releases/tag/0.4.0


PivotItem collapses after dragging TabViewItem

Describe the bug
TabViewItem dragging causes PivotItem to collapse unexpectedly
Steps to reproduce the bug

Add TabViewItem containing a Pivot
Drag the TabViewItem
Release the dragging after the Storyboard completion

Expected behavior
No response
Screenshots

NuGet package version
WinUI 2 - Microsoft.UI.Xaml 2.8.2
Windows version
Windows 11 (24H2): Build 26100
Additional context
No response

TabView content is supposed to be associated with the tab, so its content switches when toggling through tabs. This seems to be by design.
Furthermore, Pivot is not recommended anymore, and we are not planning on making fixes in this control. Please consider using SelectorBar - https://learn.microsoft.com/en-us/windows/windows-app-sdk/api/winrt/microsoft.ui.xaml.controls.selectorbar?view=windows-app-sdk-1.5


[MANIFEST] Turn on Pinpoint default pool in production

What happens when your PR merges?

Prefix the title of your PR:

[MANIFEST] or [AUTO-PR] - tag main as a new patch release and deploy to production

What are you changing?

[ ] Releasing a new version of Notify
[x] Changing kubernetes configuration

Provide some background on the changes
Turn on the Pinpoint default pool in production.
$ make diff-production
< AWS_PINPOINT_DEFAULT_POOL_ID=
---
> AWS_PINPOINT_DEFAULT_POOL_ID=pool-1240066b32d34ce896fc233a9c1c02fe

Checklist if making changes to Kubernetes:

[ ] I know how to get kubectl credentials in case it catches on fire

After merging this PR

[ ] I have verified that the tests / deployment actions succeeded
[ ] I have verified that any affected pods were restarted successfully
[ ] I have verified that I can still log into Notify production
[ ] I have verified that the smoke tests still pass on production
[ ] I have communicated the release in the #notify Slack channel.

Verified the branch locally and the encrypted changes are as advertised.


is there a  callback for the pycmdmessenger recieveing commands

how to print the recieved serial command and value ?
is there a callback function?

For example
c = PyCmdMessenger.CmdMessenger(arduino,commands)
msg = c.receive()
print(msg)


fix: fix rounding error in y-axis when max less than 1

Explanation About What Code Achieves:
Fixes this rounding issue:

So that ticks are calculated without rounding errors.
You can run getChartIntervals(0.8) to replicate this behavior:
getChartIntervals(0.8) === [ 0, 0.2, 0.4, 0.6000000000000001, 0.8 ]

I'm on version 1.6.1. Couldn't test 1.6.2 because it caused a separate bug for me and also the css file isn't present in dist/:
<EMAIL_ADDRESS>Screenshots/GIFs:
See above
Steps To Test:
Create a chart where the maximum value is 0.8.
I tried to write some test cases for this but the project doesn't have a test command (even thought it has some test files)

@scmmishra Can you do a build+release with this change?


:bug: Bubbletea initialization error handling

Changes

:bug: Bubbletea initialization error handling
:bug: Walk around for the charmbracelet/bubbletea#964 bug

/kind bug
Fixes #165
Walkaround charmbracelet/bubbletea#964
Release Note
UI initialization errors are not silenced

/test unit-tests

/cc @dsimansk

With those changes, the CI build for magetasks passes, see: https://github.com/wavesoftware/go-magetasks/actions/runs/8434810274/job/23098848334?pr=44#step:5:211


Feat(cookies): Support for cookies in load-data.js

Description
Added support for cookies in load data
Fixes # https://github.com/quintype/ace-planning/issues/470
Documentation # Will give
Type of change
Please delete options that are not relevant.

[ ] New feature (non-breaking change which adds functionality)
[ ] This change requires a documentation update

@Deokumarjnu @shraddha-kesari No need of adding this in malibu. Whichever publisher needs it will add it, we just need to provide docs

@Deokumarjnu @shraddha-kesari No need of adding this in malibu. Whichever publisher needs it will add it, we just need to provide docs

Not adding it, just added this pr to help this reviewing framework pr.

closing this pr as we are not going to merge this. publisher can implement this with the help of docs


Dataproc startup borked - trailing slash

https://github.com/populationgenomics/cpg-utils/blob/b42013b75e6812335a11ba1201cd2b9f495a4fa9/cpg_utils/dataproc.py#L284-L297
see https://batch.hail.populationgenomics.org.au/batches/442999/jobs/90
This join onto an empty String results in a trailing slash
>>> dataset_path('', 'tmp').split('://')[1]
'cpg-PROJECT-main-tmp/'

This is not tolerated during dataproc startup:
ERROR: (gcloud.dataproc.clusters.create) INVALID_ARGUMENT: Storage Bucket name 'cpg-PROJECT-main-tmp/' must match pattern '[a-z0-9\-_.]{3,222}'

proposal
remove the dataset-path call with
get_config()['storage']['default']['tmp'].removeprefix('gs://')

This would also solve the production-pipelines test use-case - config files are generated during tests, having tmp-dir test paths embedded as storage options (these do not start with gs://). I patched this here to get the test suite running, but a change in this lib would make that unnecessary.

We could use the new config_retrieve function like config_retrieve(['storage', 'default', 'tmp']) to get the bucket name


How to understand the results of EmerGNN

Dear author,
I tried the EmerGNN codes using the examples in TWOSIDES and completed the evaluate.py smoothly. However, the only out put results is the model evaluation results. How I could find the drug-drug interaction information defined by the best model?
Thanks,
Le

Sorry for the late reply. We are busy with several issues these days.
Thank you for your interest in our paper and code. The scores can be obtained through the code torch.sigmoid(self.model.enc_r(self.model.enc_ht(p_h, p_t, KG))) given the source drugs p_h, p_t and the biomedical network KG. And you can pick up the interaction with the highest score according to the returned values.

Thanks a lot for the response!
From: ZHANG YONGQI @.>
Sent: Friday, January 19, 2024 4:20 PM
To: LARS-research/EmerGNN @.>
Cc: LV Le CNBC @.>; Author @.>
Subject: Re: [LARS-research/EmerGNN] How to understand the results of EmerGNN (Issue #3)
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.

Sorry for the late reply. We are busy with several issues these days.
Thank you for your interest in our paper and code. The scores can be obtained through the code torch.sigmoid(self.model.enc_r(self.model.enc_ht(p_h, p_t, KG))) given the source drugs p_h, p_t and the biomedical network KG. And you can pick up the interaction with the highest score according to the returned values.

Reply to this email directly, view it on GitHubhttps://github.com/LARS-research/EmerGNN/issues/3#issuecomment-1899956653, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BCZZJTPE4TDLHQI2WHRCVWDYPIUCFAVCNFSM6AAAAABBPKBR32VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJZHE2TMNRVGM.
You are receiving this because you authored the thread.Message ID<EMAIL_ADDRESS>This message may contain confidential information. If you are not the designated recipient, please notify the sender immediately, and delete the original and any copies. Any use of the message by you is prohibited.


[Proposal] Publish Code Coverage stats

Code Coverage (based on code tests) is a great way to motivate/gamify the experience of doing Test and Behavior Driven Development.
Here's a couple great free-for-open-source tools for such awesomeness:

codecov.io
coveralls.io

Having a visible "how are we doing?!" stat to couple with the "build passing" badge can go along way toward encouraging effort on improving those numbers.
Cheers!
🎩

Coverage is usually done by either JaCoCo or Cobertura in maven projects and visualization tools for these badges are also available from github.
https://www.mkyong.com/maven/jacoco-java-code-coverage-maven-example/
https://www.mkyong.com/qa/maven-cobertura-code-coverage-example/
If you what to go enterprise level of testing you can visualize with SonarQube but that seems a bit overkill.

Great to know @kalaspuffar. I'm primarily looking for something that presents the status of the test coverage to potential and current developers online.
It looks like CodeCov can handle both those tools you mentioned:
https://github.com/codecov/example-java
https://github.com/codecov/example-java-maven
Coveralls has a user-provided plugin for the Maven approach:
https://github.com/trautonen/coveralls-maven-plugin


Use env package to initialize config struct

Closes #18
Use the env pkg to decode and assign the config struct.

Hello @Hoega I asked other project members to review your PR. So far so good, thank you!

Hello @Hoega,
I analyzed those packages that @mauricioabreu mentioned, but i missed the option to unmarshall another types like .yaml or .json files, even live watching changes file.
It would be more interesting we use a most versatility library to avoid refactor in the future.
Can you'd to analyze viper again or others libraries that make senses with our goal?

I don't think using files to configure env variables is a good option. I also think that Cobra is a hard lib to maintain (even if the sole purpose is fetching some environment variables). IMHO, the way @Hoega implemented it serves the purpose  very well.

Good job @Hoega

Hello, @Hoega,
Would be interesting, to add a simple validation as isNotEmpty at least, so we can trust a minimum of validation for now.
@mauricioabreu what do you think?

I could add a "required" tag or use a default value. What would you prefer? For the moment, if we enforce a required environment variable, the app crashes if it is missing.
[Fx] Error returned: received non-nil error from function "github.com/mauricioabreu/mosaic-video/internal/config".NewConfig
        /home/frouxel/mosaic-video/internal/config/config.go:25:
env: required environment variable "REDIS_HOST" is not set
[Fx] ERROR              fx.Invoke(github.com/mauricioabreu/mosaic-video/internal/worker.Run()) called from:
github.com/mauricioabreu/mosaic-video/cmd.NewRootCmd.Work.func1

@Hoega,
Oh right, it's better to use notEmpty, because required validate only if is set and not if is empty, see this.

Nice!


Set Glue Table Information when creating/updating tables

Resolves #216.
This PR adds information about the schema (on update/create) and
location (create) of the table to Glue, enabling both an improved UI
experience as well as querying with Athena.
It follows mainly the behavior in the Java library

Also, if possible, could you please also add some tests in integration_test_glue.py? This test contains similar content in test.glue.py but it interacts with the real Glue service. To run the test, you will need AWS credentials and specify a bucket via env variable AWS_TEST_BUCKET: https://github.com/apache/iceberg-python/blob/3085c404c99ba8c5c8856f21a6c8d63a12ca0113/tests/conftest.py#L1701-L1706

Also, if possible, could you please also add some tests in integration_test_glue.py? This file contains similar tests in test.glue.py but it interacts with the real Glue service. To run the test, you will need AWS credentials and specify a bucket via env variable AWS_TEST_BUCKET:
https://github.com/apache/iceberg-python/blob/3085c404c99ba8c5c8856f21a6c8d63a12ca0113/tests/conftest.py#L1701-L1706
Thanks!

Hi @HonahX thanks for the review! I’ll have a look soon, but I just wanted to get a feeling about what we should test in the integration test that’s not covered here. IMHO, for this update I think a full test that looks like:

make a table with pyiceberg
verify subsequent query with Athena

would make sense, but would possibly require a little more than just access to a bucket. (I’m just not sure about if there are any limitations on the CI AWS account.)
i will anyways go in that direction, let me know if you had something else in mind.

Thanks @mgmarino/@HonahX something else that comes to mind when working with glue/ Athena (valid for other engines too).
Did you try to evolve the table schema and see if the changes are properly updated in glue and usable in Athena? Also I'm wondering if such "check" should be a dedicated test case, unit tests (moto mocking) plus an integration test?

@mgmarino @nicor88 Thanks for your input.

Did you try to evolve the table schema and see if the changes are properly updated in glue and usable in Athena?

I did a simple test
table = catalog.load_table(table_identifier)
table.update_schema().add_column("y", StringType()).commit()
to_append2 = pa.Table.from_pandas(
    pd.DataFrame([dict(x="hello!", y="world!")])
)
table.append(to_append2)

and the Athena could successfully run SELECT * FROM on the updated table: both the original column and new column show up in the result.
For testing, I think it would be nice to add one or two Athena-related checks to both unit tests and integration tests. However , I think moto does not run Athena query by default, which cannot help us verify the Athena behavior in unit test. So, may be adding such check in integration tests is good enough. (Please correct me if I am wrong about moto athena)

Thanks, @HonahX, @nicor88.
Yes, I verified the correct behavior as well (creation of table, schema change, etc.) before pushing, but I am happy to formalize this in an integration test and will do so. :-)
Re moto: for me, the only real value of moto is in ensuring that we call the aws API correctly. I think we can't rely on it to reproduce the internal functionality of AWS services, and certainly not an Athena query, so I would simply go the direction of doing this an integration test.

Regarding moto - I totally agree with you @mgmarino, it helps to test only API specs, and as the main catalog source of true is glue (also for athena), mocking athena via moto is not enough.
Therefore, to support both of your comments, I believe that integration testing for Athena/glue/s3 are the only way to fully test and assure that all works as expected - this is the same path that we took also in https://github.com/dbt-athena/dbt-athena, where we use moto for unit tests, but then we have end to end tests were we test full athena/glue behaviour (for iceberg tables included).

@HonahX I just realized that the integration tests for glue are not automatically collected/run in CI, so I guess these are just up to "us" to run by hand? That makes it a bit easier, I thought I might need to do something else, let me know if I missed anything here.

@mgmarino You are correct. We need to use our own AWS accounts to run them.

@mgmarino @HonahX - I was testing this, and after the change I confirm that I can query the table in Athena (I'm still doing some deep dive on why the table is not droppable in athena), but anyhow, I have a weird behvior:
if I run
data = [
    {"x": "Alice"},
    {"x": "Bob"}
]
df = pd.DataFrame(data)

to_append = pa.Table.from_pandas(df)

t.append(to_append)

In the final table I expect to have multiple records for my table with x=Alice, and it's not the case.
Then I run:
data = [
    {"x": "Alice v1"},
    {"x": "Bob v1"}
]
df = pd.DataFrame(data)

to_append = pa.Table.from_pandas(df)

t.append(to_append)

as I was expecting an overwrite behaviour - but I still get the first snapshot.
Checking the data folder seems that the parquet files are written, also new metadata files, but glue catalog still point to the old snapshot - and that's definitely not right. Am I missing something here?

Integration tests added in 40ab6e617c96712d5020e06b741fdbbd1963e75a

@mgmarino @HonahX - I was testing this, and after the change I confirm that I can query the table in Athena (I'm still doing some deep dive on why the table is not droppable in athena), but anyhow, I have a weird behvior: if I run this multiple times
data = [
    {"x": "Alice"},
    {"x": "Bob"}
]
df = pd.DataFrame(data)

to_append = pa.Table.from_pandas(df)

t.append(to_append)

@nicor88. I tried the same code you posted along with this PR, and it seemed to work on my side. Each time I ran the code, a new "Alice" and a new "Bob" were appended to the table. Do you still have the same issue on your side?

@nicor88. I tried the same code you posted along with this PR, and it seemed to work on my side. Each time I ran the code, a new "Alice" and a new "Bob" were appended to the table. Do you still have the same issue on your side?

I also tried this and could not reproduce the problem (i.e. I saw the additional rows).

@HonahX @mgmarino all good on my side, all worked with a new table and with the last commit 💯
great work @mgmarino !

Overall LGTM! Thank you very much @mgmarino! Just adding one final request to make IcebergSchemaToGlueType internal by adding _. Sorry I missed that early

Sure, np!

I've added this to 0.6.0 milestone to ensure that Athena users can query the table written by pyiceberg after releasing write support.

🎉
Thanks, @HonahX and @nicor88, for the input and reviews!


MATE keyboard shortcuts settings incomplete

Issue description
Using MATE, under Keyboard Shortcuts, the only two categories are "Sound" and "Desktop". I do not see "Window Management", "Accessibility", or any other categories.
There was a similar issue with GNOME: #19590.
Steps to reproduce
In MATE, go to System -> Preferences -> Hardware -> Keyboard Shortcuts.
Technical details

system: "x86_64-linux"
host os: Linux 4.14.97, NixOS, 18.09.2096.2ff7ef373e5 (Jellyfish)
multi-user?: yes
sandbox: yes
version: nix-env (Nix) 2.1.3
nixpkgs: /nix/var/nix/profiles/per-user/root/channels/nixos

This has been fixed in on master in https://github.com/NixOS/nixpkgs/pull/60401.
Your host appears to be on 18.09 so it will be broken there because it doesn't have this fix.

I am on the unstable channel, so after a nix-channel --update and nixos-rebuild switch, I now see the missing shortcuts.  Thanks!


"Unable to resolve slug into ID (no matches)"

Describe the problem
"foamfix-for-minecraft"s slug has appeared to have changed to "foamfix-optimization-mod" which is forcing the container to exit. When I try to exclude foamfix-for-minecraft nothing changes. I attempted to create another container using AUTO_CURSEFORGE using ATM9 and got the same error with foamfix.

Container definition

services:
  mc:
    image: itzg/minecraft-server
    tty: true
    stdin_open: true
    ports:
      - "25565:25565"
    environment:
      VERSION: "1.20.1"

      SERVER_NAME: "Helium - Better MC"
      ICON: https://static.wikia.nocookie.net/minecraft_gamepedia/images/5/57/Helium.png/revision/latest?cb=20180620192736
      OVERRIDE_ICON: "TRUE"

      TYPE: "AUTO_CURSEFORGE"
      CF_API_KEY: ''
      CF_PAGE_URL: https://www.curseforge.com/minecraft/modpacks/better-mc-forge-bmc4/files/5418297
      CF_EXCLUDE_MODS: "foamfix-for-minecraft"
      MEMORY: "6GB"
      EULA: "TRUE"
    volumes:
      # attach the relative directory 'data' to the container's /data path
      - ./data:/data

Container logs
[init] Running as uid=1000 gid=1000 with /data as 'drwxr-xr-x 5 1000 1000 4096 Jul  7 00:39 /data'
[mc-image-helper] 01:29:52.840 INFO  : Processing modpack 'Better MC [FORGE] 1.20.1 v28' (better-mc-forge-bmc4) @ 876781:5418297
[mc-image-helper] 01:29:53.015 ERROR : 'install-curseforge' command failed. Version is 1.39.3
me.itzg.helpers.errors.GenericException: Unable to resolve slug into ID (no matches): foamfix-for-minecraft
        at me.itzg.helpers.curseforge.CurseForgeApiClient.lambda$slugToId$7(CurseForgeApiClient.java:178)
        at java.base/java.util.Optional.orElseThrow(Unknown Source)
        at me.itzg.helpers.curseforge.CurseForgeApiClient.lambda$slugToId$8(CurseForgeApiClient.java:178)
        at reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onNext(FluxMapFuseable.java:113)
        at reactor.core.publisher.MonoFlatMap$FlatMapMain.secondComplete(MonoFlatMap.java:245)
        at reactor.core.publisher.MonoFlatMap$FlatMapInner.onNext(MonoFlatMap.java:305)
        at reactor.core.publisher.FluxContextWrite$ContextWriteSubscriber.onNext(FluxContextWrite.java:107)
        at reactor.core.publisher.FluxDoFinally$DoFinallySubscriber.onNext(FluxDoFinally.java:113)
        at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:158)
        at reactor.core.publisher.MonoPublishOn$PublishOnSubscriber.run(MonoPublishOn.java:181)
        at reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:68)
        at reactor.core.scheduler.SchedulerTask.call(SchedulerTask.java:28)
        at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
        at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.base/java.lang.Thread.run(Unknown Source)
        Suppressed: java.lang.Exception: #block terminated with an error
                at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:103)
                at reactor.core.publisher.Mono.block(Mono.java:1712)
                at me.itzg.helpers.curseforge.CurseForgeInstaller.resolveExcludeIncludes(CurseForgeInstaller.java:663)
                at me.itzg.helpers.curseforge.CurseForgeInstaller.processModpack(CurseForgeInstaller.java:548)
                at me.itzg.helpers.curseforge.CurseForgeInstaller.resolveModpackFileAndProcess(CurseForgeInstaller.java:400)
                at me.itzg.helpers.curseforge.CurseForgeInstaller.installByRetrievingModpackZip(CurseForgeInstaller.java:262)
                at me.itzg.helpers.curseforge.CurseForgeInstaller.lambda$install$3(CurseForgeInstaller.java:181)
                at me.itzg.helpers.curseforge.CurseForgeInstaller.install(CurseForgeInstaller.java:218)
                at me.itzg.helpers.curseforge.CurseForgeInstaller.install(CurseForgeInstaller.java:180)
                at me.itzg.helpers.curseforge.InstallCurseForgeCommand.call(InstallCurseForgeCommand.java:213)
                at me.itzg.helpers.curseforge.InstallCurseForgeCommand.call(InstallCurseForgeCommand.java:29)
                at picocli.CommandLine.executeUserObject(CommandLine.java:2045)
                at picocli.CommandLine.access$1500(CommandLine.java:148)
                at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2465)
                at picocli.CommandLine$RunLast.handle(CommandLine.java:2457)
                at picocli.CommandLine$RunLast.handle(CommandLine.java:2419)
                at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2277)
                at picocli.CommandLine$RunLast.execute(CommandLine.java:2421)
                at picocli.CommandLine.execute(CommandLine.java:2174)
                at me.itzg.helpers.McImageHelper.main(McImageHelper.java:159)

Also getting, but very weird since foam hasnt been a dependency for atm since atm3

The error seems to stem from the recent push https://github.com/itzg/docker-minecraft-server/commit/c87145a5e46761bc4505ac114207d6d03d945a8c. The 'foamfix-for-minecraft' name isn't correct any longer so causes this error.

Stay tuned, there's more I have to fix due to https://github.com/itzg/docker-minecraft-server/pull/2967

Should be fixed now by #2969 and #2970

I removed my container and pulled the latest image, but I'm still receiving the same error. How do I go about spinning up my server container with the newest possible version?

Since JEI is also included in globalExcludes, it seems that there might be an issue with it being deleted even though it is necessary for ATM9, preventing it from launching.
[mc-image-helper] 13:29:57.224 INFO : Removing old file mods/jei-1.20.1-forge-<IP_ADDRESS>.jar
...
[main/ERROR] [ne.mi.fm.lo.ModSorter/LOADING]: Missing or unsupported mandatory dependencies:
        Mod ID: 'jei', Requested by: 'jearchaeology', Expected range: '[14,)', Actual version: '[MISSING]'
        Mod ID: 'jei', Requested by: 'justenoughprofessions', Expected range: '[<IP_ADDRESS>,)', Actual version: '[MISSING]'

@Shotman If you're making it that far then your issue is not directly related to originally reported one. What you may want to try is setting CF_FORCE_SYNCHRONIZE to "true" to ensure the latest exclusions are applied. Otherwise, you might need to increase health check timeout.

I am receiving the same error as the original, but with "compasscoords"
me.itzg.helpers.errors.GenericException: Unable to resolve slug into ID (no matches): compasscoords
Which appears to have changed it's slug to "compass-coords" : https://www.curseforge.com/minecraft/mc-mods/compass-coords


add llama2 format

Description
Added a new prompt version of llama2-chat by following https://huggingface.co/blog/llama2#how-to-prompt-llama-2. This PR enables to evaluate all llama2 variants including ELYZA-japanese-Llama-2-7b-instruct.
Usage
2 key points:

Set the correct system prompt as SYSTEM_PROMPT environment variable
Use 0.6 for prompt version

# Make sure to set the correct system prompt
export SYSTEM_PROMPT="You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe.  Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\n\nIf a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information."

MODEL_ARGS="pretrained=meta-llama/Llama-2-7b-chat-hf"
TASK="jsquad-1.1-0.6,jcommonsenseqa-1.1-0.6,jnli-1.1-0.6,marc_ja-1.1-0.6,jaqket_v2-0.2-0.6,xlsum_ja-1.0-0.6,xwinograd_ja,mgsm-1.0-0.6"
python main.py \
   --model hf-causal \
   --model_args $MODEL_ARGS \
   --tasks $TASK \
   --num_fewshot "2,3,0,0,1,1,0,5" \
   --device "cuda" \
   --output_path "models/llama2/llama2-7b-chat/result.json"

@mkshing  quick comment but maybe we can start to use llama2 instead of 0.6 to improve readability? This is suggested by @polm-stability on Slack as well

@leemengtw Yeah I agree your point but we need to deprecate the integer version and rename all, which takes extra work.So, at least, in this PR, I want to keep the integer format.


Update React boilerplate to v15

Looks like the boilerplate is still running on 0.14. Other boilerplates might need tweaks as well.
Feature idea: Make it possible to point to a GitHub based boilerplate (the user passes an url and WebpackBin picks it up then).

Yeah, that would be great. When Users are implemented it will be a lot easier to handle boilerplates. Doing it manually now. Will change this as soon as I get a chance :)


Semantic segmentation using TensorFlow models

Feature request
Description
Many semantic segmentation models are implemented in TensorFlow (Deeplab, ICNet, and so on). It would be useful to have a node for loading semantic segmentation models for inference on camera image topics.
Implementation considerations
Implemented with the TensorFlow wrapper from issue #2178.
Alternatives
Semantic segmentation using ENet (implemented using caffe) is already implemented in computing/perception/detection/vision_detector/packages/vision_segment_enet_detect.
The current state-of-the-art (DeepLabv3) is available pre-trained on Cityscapes in TensorFlow.

I built a package that you might find interesting that opens freeze graphs of segmentation / detection and publishes them to ROS. https://github.com/wew84/cnn_bridge


OAuth rebarized

Hello Tim
I just rebarized OAuth and defined consumer record definition in hrl-file to include it in other applications

Hey Maxim. Thanks for putting this together, nice clean changes like this are much easier to review! I'm a bit unclear on the motivation for the changes.
Regarding Rebarizing: erlang-oauth can be built with rebar without a rebar.config file, and make works just fine too. Not sure what problem this solves?
Regarding .gitignore: if you work on a lot of Erlang projects I highly recommend setting up a global excludesfile that includes *.beam, then you don't have to specify that on each project.
Regarding records: no complaints with your code, but tuples are working fine at the moment, so not sure what issue that fixes?
Regarding ssl: it isn't specified as a dependency because it's not strictly required. Although OAuth over SSL is probably more common in the wild than OAuth over plain HTTP, I don't think it's necessary to require it.


add scale prop / retina compatibility

specify source image scale with the scale prop
retina images (@2x) use the scale factor 2 which scales the output by 0.5

looks great! thanks for this.


Enhance: card of the Iskon feature page.

I would like change the UI of the card of iskon page to make it more attractive.

I would like to make card more attractive by adding cool effects.
So, please assign this issue to me under GSSOC'23.

This issue is already being worked on @Pragati-3003 refer #76
Please explore other issues to contribute to
Feel free to raise more issues, we will review them and assign them to you

I am interested to work on this issue under GSSoC 2023 as a contributor


What happens after the definition bucket is updated?

Does it scan again all the inputBuckets? Or is the scanning only triggered by fileUpload to inputBucket?
I am trying to avoid the corner case when a previously 'CLEAN' file, would be flagged as 'INFECTED' due to definition update.
Thank you !
P.S.: Perhaps this information could also be added to the README.md

Or is the scanning only triggered by fileUpload to inputBucket?

This is the behavior. This is not a continual scanning solution.

Perhaps this information could also be added to the README.md

Would this make it clearer?
"An aws-cdk construct that uses ClamAV® to scan newly uploaded objects in Amazon S3 for viruses."

Thanks for the clarification.
I will open a PR with the proposed change.


OCPBUGS-15489: manifests: add new PrometheusRule for recording rules

In https://github.com/openshift/cluster-kube-apiserver-operator/pull/1484 recording rules were added to the PrometheusRule which was supposed to be removed by CVO (it has release.openshift.io/delete: "true" annotation). This PR moves recording rules to a new PrometheusRule - and fixes missing datapoints on apiservers dashboard.
After https://github.com/openshift/cluster-authentication-operator/pull/616 was merged openshift-oauth-apiserver is available on the dashboard, so this PR updates recording rules to include it as well.
This also removes unnecessary v2 suffix in dashboard name

/jira refresh

In https://github.com/openshift/cluster-kube-apiserver-operator/pull/1484 recording rules were added to the PrometheusRule which was supposed to be removed by CVO (it has release.openshift.io/delete: "true" annotation)

does it mean that at some point we can remove the old recording rule?

does it mean that at some point we can remove the old recording rule?

Yes - https://issues.redhat.com/browse/OCPBUGS-15504, although I'm not sure if it can happen in 4.14 or needs to be deferred to 4.15

/lgtm
/approve


Fixed : new URL for gitkraken

The url for GitKraken has changed, and deb-get was unable to see the updated version.

Sorry, I messed up my PR. I'll resubmit.


added safe.share.safenet web app

Hello !
Would you consider adding this contribution ? thank you very much !

Sure 😃  Thank you for the PR 👍


Uninstall on Windows asks for admin permissions

Prerequisites

[X] Put an X between the brackets on this line if you have done all of the following:

Reproduced the problem in Safe Mode: https://flight-manual.atom.io/hacking-atom/sections/debugging/#using-safe-mode
Followed all applicable steps in the debugging guide: https://flight-manual.atom.io/hacking-atom/sections/debugging/
Checked the FAQs on the message board for common solutions: https://discuss.atom.io/c/faq
Checked that your issue isn't already filed: https://github.com/issues?utf8=✓&q=is%3Aissue+user%3Aatom
Checked that there is not already an Atom package that provides the described functionality: https://atom.io/packages

Description
Atom can be installed without admin privileges, so uninstall should not ask for admin password either.
Steps to Reproduce

Go to Windows 10's "Apps&Features"
Find Atom and click "Uninstall"

Expected behavior:
Uninstall
Actual behavior:
Requests admin password
Reproduces how often:
Always
Versions
Atom    : 1.38.2
Electron: 2.0.18
Chrome  : 61.0.3163.100
Node    : 8.9.3

Thanks for the report -

Go to Windows 10's "Apps&Features"

I'm guessing you don't see the UAC prompt if you uninstall from Programs and Features?
Based on https://github.com/Squirrel/Squirrel.Windows/issues/1209, Squirrel (the installer framework we use) doesn't need admin permission to uninstall and this is likely an issue with Windows when uninstalling from Apps & Features.


TemplatedControl::ArrangeOverride/Render is not called after updating 0.10.0-preview3 to 0.10.0-preview4

Environment: Windows 10 x64, .NET Core 3.1 (x64)
Sample App: https://github.com/vmas/bug-avalonia-0.10.0-preview4
Avalonia 0.9.12:

0.10.0-preview3, 0.10.999-cibuild0010242-beta (DrawingContext::DrawText not working?):

0.10.0-preview4, 0.10.999-cibuild0010245-beta and newer:

Breaking changes: https://github.com/AvaloniaUI/Avalonia/compare/82a473a...2a89ba9

Fxed in c5dfba31. Works with 0.10.999-cibuild0010810-beta and newer.