Are Network Security Groups supported on the application gateway subnet?

Exceptions must be put in for incoming traffic on ports 65503-65534 for the Application Gateway v1 SKU and ports 65200 - 65535 for the v2 SKU. This port-range is required for Azure infrastructure communication. They are protected (locked down) by Azure certificates. Without proper certificates, external entities, including the customers of those gateways, will not be able to initiate any changes on those endpoints.

I think it should be clarified that this rule is not strictly speaking required.
When I denied 65503-65534 in my NSG, my app traffic could still be routed through the gateway, because the application still responded to health probes. The application and gateway are within the same VNET and VNET to VNET traffic was allowed in the NSG.
The only thing that did not work was Backend Health tab in the gateway - it showed Unknown health status.
It's also not necesssary to open this rule to the Internet. You can pick GatewayManager service tag (in my instance, GatewayManager.WestEurope) and the backend health tab will come back with Healthy status. AzureCloud service tag will also do - which is a much smaller address space than the internet.
It could also be more spelled out that destination for this rule should only be the gateway subnet and none other.
Similar thing is repeated in:
https://docs.microsoft.com/en-us/azure/application-gateway/application-gateway-faq#can-i-whitelist-application-gateway-access-to-a-few-source-ips

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 88466307-81b8-1e5b-7f2c-191d8e818071
Version Independent ID: 08ad49f3-6a57-b925-794a-37215e985aba
Content: Frequently asked questions for Azure Application Gateway
Content Source: articles/application-gateway/application-gateway-faq.md
Service: application-gateway
GitHub Login: @vhorne
Microsoft Alias: victorh

@TravisCragg-MSFT I have an update to this.
The documentation is correct for V2 App Gateway, as this (unprecendented) behaviour was added to App Gateway V2 deployment:
Network security group
<id> blocks incoming internet traffic on ports 65200 - 65535 to subnet
<id>, associated with Application Gateway
<id>. This is not permitted for Application Gateways that have V2 Sku.

I suppose the issue can be closed as the documentation is correct.
However, can you advise on what is the best place to leave product behaviour feedback, as I believe it is wrong. Microsoft should always recommend the most secure advice. Opening an endpoint to the Internet tag is far less secure, when we know that the traffic will be coming from a much narrower service tag. As such, the behaviour and subsequently the documentation recommend a less secure practice.

@xenalite App Gateway V2 is still in preview, and there will be changes and features regularly during this time, along with some strange functions like this.
Please give any Feature Requests or Feedback you have for App Gateway V2 Here.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.

@TravisCragg-MSFT Thank you.
Link to product feedback:
https://feedback.azure.com/forums/217313-networking/suggestions/36933709-remove-nsg-validation-from-app-gateway-v2-deployme

@TravisCragg-MSFT same issue here, I was not able to configure the proper NSG rule that satisfies the rule check on AzureRM deployment.
No matter how open I make the NSG rule, deployment always fails with this error:
Microsoft.Network/applicationGateways 'net-appgateway-xxxxxxxx' failed with message '{
  "error": {
    "code": "ApplicationGatewaySubnetInboundTrafficBlockedByNetworkSecurityGroup",
    "message": "Network security group /subscriptions/xxxxxx-xxxxxx-xxxxxx-xxxxxx/resourceGroups/tt-dev1/providers/Microsoft.Network/networkSecurityGroups/nsg-Subnet-AppGw-xxxxxxxx blocks incoming internet traffic on ports 65200 - 65535 to subnet /subscriptions/xxxxxx-xxxxxx-xxxxxx-xxxxxx/resourceGroups/tt-dev1/providers/Microsoft.Network/virtualNetworks/net-vnet-xxxxxxxx/subnets/Subnet-AppGw, associated with Application Gateway /subscriptions/xxxxxx-xxxxxx-xxxxxx-xxxxxx/resourceGroups/tt-dev1/providers/Microsoft.Network/applicationGateways/net-appgateway-xxxxxxxx. This is not permitted for Application Gateways that have V2 Sku.",
    "details": []
  }
}'

I tried all of these variations, but the deployment always fails due to the above rule check:
with explicit service tag 'Internet' for source / 'VirtualNetwork' for destination:

with source 'Any' and subnet CIDR for destination:

UPDATE: it finally worked with using "Any" destination (which is way too open):

Now I' struggling with the next validation error for the outbound rule...
@TravisCragg-MSFT regarding the docs, it would be helpful if the concrete rules that need to be added would be documented (for sure it would be better if the rule checks would be fixed, but at least until then the docs would help the users to set up the rules -- even if too open for now -- correctly)

After finally finding out the required inbound rule, I am now as open as it possibly can be with my outbound rules:

But still getting the "ApplicationGatewaySubnetOutboundTrafficBlockedByNetworkSecurityGroup" rule validation error below:
PM - Resource Microsoft.Network/applicationGateways 'net-appgateway-xxxxxxxxxx' failed with message '{
  "error": {
    "code": "ApplicationGatewaySubnetOutboundTrafficBlockedByNetworkSecurityGroup",
    "message": "Network security group /subscriptions/xxxxxx-xxxxxx-xxxxxx-xxxxxx/resourceGroups/tt-dev1/providers/Microsoft.Network/networkSecurityGroups/nsg-Subnet-AppGw-xxxxxxxxxx blocks outgoing internet traffic on subnet /subscriptions/xxxxxx-xxxxxx-xxxxxx-xxxxxx/resourceGroups/tt-dev1/providers/Microsoft.Network/virtualNetworks/net-vnet-xxxxxxxxxx/subnets/Subnet-AppGw, associated with Application Gateway /subscriptions/xxxxxx-xxxxxx-xxxxxx-xxxxxx/resourceGroups/tt-dev1/providers/Microsoft.Network/applicationGateways/net-appgateway-xxxxxxxxxx. This is not permitted for Application Gateways that have fast update enabled or have V2 Sku.",
    "details": []
  }
}'

@xenalite @TravisCragg-MSFT any ideas how to fix this?

@tknerr try removing your "BlockAllOutbound" rule. The validation seems to be quite strange, and even though there is a higher priority AllowAll rule, it still does not like the block.
You should also go vote for Xenalite's feedback asking for the removal of the NSG validation.

@TravisCragg-MSFT thanks for the suggestion, I will try that and report back if that helped or not
Left my votes + comments on @xenalite's feedback.azure.com entry as well :)

@TravisCragg-MSFT thanks for the suggestion. By removing the lower prio "blockAllOutbound" rule I could indeed bypass the rule validation error and got the AppGateway v2 deployment to finally work.
Not ideal imho but it works for now and good enough to continue with evaluation of AppGw v2 on our end.
Maybe that would be worth a mentioning as a known issue in the docs though, maybe in https://github.com/MicrosoftDocs/azure-docs/blob/master/articles/application-gateway/application-gateway-autoscaling-zone-redundant.md#known-issues-and-limitations / #23773 ?

@vhorne can you add a note to the known issues that no rules can block outbound access besides the default rules to the known issues?

@tknerr In principle you could work around this - deploy AGWv2 and have your rules.
In your ARM template, you could first deploy NSG attached to no subnets, then deploy AGW, then attach NSG to subnets. Because ARM is DSC, it will ensure NSG is not attached before AGW on every redeployment.

@tknerr In principle you could work around this - deploy AGWv2 and have your rules.
In your ARM template, you could first deploy NSG attached to no subnets, then deploy AGW, then attach NSG to subnets. Because ARM is DSC, it will ensure NSG is not attached before AGW on every redeployment.

This workaround doesn't work. I had a NSG with inbound/outbound in place & then created an application gateway v2. Then I tried to attach the NSG to the gateway that the AGv2 is running on but the validation fails with the folowing error:
Failed to save network security group for subnet 'gateway_subnet_v2'. Error: Network security group XX/XX/XX-NSG blocks outgoing internet traffic on subnet XXX/subnets/gateway_subnet_v2, associated with Application Gateway XXX/XXX/XXX-v2. This is not permitted for Application Gateways that have fast update enabled or have V2 Sku.
The workaround suggested by @tknerr might work but I do not feel comfortable removing the deny all rule. The validation check on the NSG rule is a little ludicrous in my opinion, why should users have to leave their entire virtual network (not just the AG subnet) open to outbound traffic for this to work?!

As of today I'm still unable to limit the INBOUND ports (65200-65353) on the Application Gateway V2 SKU to the "GatewayManager.<region", "GatewayManager", or "AzureCloud" Service Tags.. It does appear to accept "Internet" Service Tag.. But this is a problem when trying to get PCI Audit accpeted as you can well imagine. Can someone from AppGW PG please respond with an update to this "bug".

Hi @TravisCragg-MSFT , you closed the issue but I'm affected, any news on this?
Thanks,

@xenalite guidance on NSGs for the App Gateway subnet was moved Here. Can you clarify your current issue?

@TravisCragg-MSFT the page you linked to no longer has the guidance. The issues with the outgoing rule appear to still be present (currently fighting this now).

@TravisCragg-MSFT the page you linked to no longer has the guidance. The issues with the outgoing rule appear to still be present (currently fighting this now).

i'm currently suffering the "blocks outgoing internet traffic on subnet" issue;   inbound was fixed by ordering the rules correctly;  however outbound nsg rules don't work even open


Not picking up Disk errors (yet?)

I currently have one disk (no 6) which has failed me. Unraid has disabled it, but due to parity the array is still working as it should.

I however do not see anything on this in HA

Is this a feature you have not yet implemented?

Ok just saw on your HA community post that Extended disk health monitoring is on the future plans.

@mvanlijden will get the disk health feature sorted out as soon as possible. Hopefully before Christmas😊

@mvanlijden I have updated the code and added SMART features to show disk temps and status of the disk.
Just doing some tests with other updates before releasing a new version.

Looking good! Love to put it in attributes as this doesn't pollute the long list of entities. I can pull it out for dashboard purposed with templating :)

@mvanlijden I release a new version that should show disk errors. Let me know if it works

@domalab I don't think it is fully working yet. A lot of data is not interpreted correctly. My findings just now:
It does show Unraid parity details and status in de the attributes, but generic status is still unknown?

Details on a healthy disk do show, but no temperature or smart results. This is only visible for disks which are spinned up.
For temperature that makes sense as it follows the behavior in Unraid. But maybe you should cache the temperature data?

With a spinned up disk the smart check is read and the temp. But the last smart check

Also a bigger issue is that the disk number do not match. I do not which sort they use, but they are mixed up. I first thought they used device sort (sda,sdb,sdc) instead of the disk numbering in Unraid. But that is also not the case. But I also means that the mounting points in HA are incorrect.

My failed disk (sde / disk 6), is split in details between disk 2 and 6 in HA:

Device and model (and smart?) are linked in disk 2. Usage and size seem to be linked in disk 6 (the correct mounting point).
However none seem to pick up that the disk has failed.
Would any specific logging or print from Unraid help you? Please let me know what you need.

@mvanlijden Thanks for your feedback. Can you please run the following commands on your unraid server --> console and provide the outputs back to me?
Download Diagnostics file

Get all disk information including SMART status
for disk in /dev/sd[a-z]; do
echo "=== $disk ==="
smartctl -a $disk
echo "---"
done
Get Unraid disk assignments and mapping
cat /boot/config/disk.cfg
ls -l /dev/disk/by-id/
Get array configuration
cat /proc/mdstat
mdcmd status
Get disk mount points and usage
df -h /mnt/disk*
mount | grep "mnt/disk"
Get current disk states
hdparm -C /dev/sd[a-z]
Get parity status
cat /proc/mdcmd

You can also run this script from Unraid --> User Scripts plugin to create disk diagnostic file.
unraid_disk_diagnostics.sh.zip

I'll do that today once I sit behind my laptop 👍🏻

Diagnostics output.txt
Here you go

Diagnostics output.txt
Here you go

Thank you. I'll see if I can sort out the disk mappings bug next week.

@mvanlijden I made updates to code to check disk mappings.
Feel free to test it on your system and let me know if it works for you.
I haven't officially released a new version yet as I'm still testing other fixes I implemented.
Copy the code files from unraid folder in repo to your custom_components\unraid folder and restart home assistant.
Best to test it on HA Dev instance if you have one.

I changed the files (yesterday) and also removed and readded the integration, as the entity naming changed as well.
Things still do not match. See screenshots below. Number do not match Unraid.
Health status not visible on disk 6, nor on disk 5 (linked to device sde)

Also another find, it now does not show Dockers service as being active, even though it is?
Also it is not adding my dockers as entities anymore?

I changed the files (yesterday) and also removed and readded the integration, as the entity naming changed as well.
Things still do not match. See screenshots below. Number do not match Unraid.
Health status not visible on disk 6, nor on disk 5 (linked to device sde)

Also another find, it now does not show Dockers service as being active, even though it is?
Also it is not adding my dockers as entities anymore?

I spent a bit of time on understanding how the disk mapping in unraid works and updated the code.


Segmentation fault on MacOS with libomp 12.0.0

The following code results in a Python segmentation fault when executed with Python 3.x on MacOS with libomp 12.0.0. Downgrading to a previous version of libomp solves it.
# xgboost macos seg fault when libomp==12.0.0
# passes with libomp==11.1.0

"""
	verify libomp version
		brew list --version libomp
		libomp 12.0.0
	to install libomp 11.1.0
		wget https://raw.githubusercontent.com/chenrui333/homebrew-core/0094d1513ce9e2e85e07443b8b5930ad298aad91/Formula/libomp.rb
        brew unlink libomp
        brew install --build-from-source ./libomp.rb
        brew list --version libomp

"""

import logging
import numpy as np
import xgboost as xgb

def xgboost_unit_tests():
	feature_arr = np.random.uniform(size=(100,5))
	label_arr = np.random.randint(low=0, high=10, size=(100,1))
	data_arr = np.concatenate((feature_arr, label_arr), axis=1)
	#Run Attribute Rank with -O 2
	run_xgboost(data_arr,data_arr)
	logging.info("XGBoost complete")
	return

def run_xgboost(trainarr, valarr):
	trainfeats = trainarr[:,:-1]
	trainlabels = trainarr[:,-1]
	# first seg fault
	dtrain = xgb.DMatrix(trainfeats, label=trainlabels)
	valfeats = valarr[:,:-1]
	vallabels = valarr[:,-1]
	# second seg fault
	dval = xgb.DMatrix(valfeats, label=vallabels)
	return

# Press the green button in the gutter to run the script.
if __name__ == '__main__':
	xgboost_unit_tests()

Just to be clear - when everything was paired down to these 40 some lines of code, the seg fault 11 was replaced with the dumping of source code to the screen. i.e. "warnings.warn(".  This line of code has shifted up or down a couple of times.
andys@MacBook-Pro:~/work/xgboost-macos-seg-fault-11$ python3 main.py
/Users/andys/.pyenv/versions/3.8.7/lib/python3.8/site-packages/xgboost/data.py:104: UserWarning: Use subset (sliced data) of np.ndarray is not recommended because it will generate extra copies and increase memory consumption
  warnings.warn(
andys@MacBook-Pro:~/work/xgboost-macos-seg-fault-11$

We believe that this code leakage is what is producing the seg fault on our much more complex program located at
pip install brainome

The last work around we figured out was importing xgboost immediately on start clears out the macos seg fault 11 issue.  Our program had it imported only as necessary very late in the execution cycle.

We noticed it on github action test.  Seems to be a bug in libomp: https://bugs.llvm.org/show_bug.cgi?id=50579

Related:

https://github.com/dmlc/xgboost/pull/6895
https://github.com/microsoft/LightGBM/issues/4229

TY hopefully this will document the workarounds for the next folks to fall into this trap

@trivialfis
Maintainers of libomp have notice this issue, but they cannot reproduce the crash with my provided information. I am thinking that maybe you can take a look at this thread and provide more useful information (than mine😢)
Thank you

My apologies, I don't have a mac device and cannot provide any further information.  If anyone is watching this thread please help with the libomp maintainers.

I have a really simple test harness that reproduces the segmentation fault at
https://github.com/brainome/xgboost-macos-libomp-seg-fault/blob/main/main.py

Hello everyone, I tested libomp 13.0.0 today and I was able to run the example script without any segfault.
I'll close this issue once I test libomp 13.0.0 in CI.
Ps. Some findings:

The segfault happens for libomp 12.0.0 from Homebrew, but not for libomp 12.0.0 from Conda.
libomp 12.0.0 from Conda applies a patch (https://reviews.llvm.org/D105308), whereas libomp 12.0.0 from Homebrew applies no patch. So we can conclude that the patch fixes the segfault.
The patch is part of libomp 13.0.0.

Update: I ran into another segfault, this time using libomp 13.0.0. #7618 is hanging too.
It appears that two different versions of libomp are being loaded in, one from Conda (llvm-openmp), and another one from Homebrew.
Stack trace:
* thread #9, stop reason = EXC_BAD_ACCESS (code=1, address=0x8)
  * frame #0: 0x000000011e62e54f /usr/local/Caskroom/miniconda/base/lib/libomp.dylib`void __kmp_suspend_64<false, true>(int, kmp_flag_64<false, true>*) + 47
    frame #1: 0x000000011ef33f00 /usr/local/opt/libomp/lib/libomp.dylib`kmp_flag_64<false, true>::wait(kmp_info*, int, void*) + 1440
    frame #2: 0x000000011ef30e97 /usr/local/opt/libomp/lib/libomp.dylib`__kmp_hyper_barrier_release(barrier_type, kmp_info*, int, int, int, void*) + 151
    frame #3: 0x000000011ef3362c /usr/local/opt/libomp/lib/libomp.dylib`__kmp_fork_barrier(int, int) + 445
    frame #4: 0x000000011ef1bf5a /usr/local/opt/libomp/lib/libomp.dylib`__kmp_launch_thread + 194
    frame #5: 0x000000011ef48934 /usr/local/opt/libomp/lib/libomp.dylib`__kmp_launch_worker(void*) + 278
    frame #6: 0x00007fff6a968109 libsystem_pthread.dylib`_pthread_start + 148
    frame #7: 0x00007fff6a963b8b libsystem_pthread.dylib`thread_start + 15

I'm inclined to adopt the fix from https://github.com/scikit-learn/scikit-learn/pull/22109. The idea is to bundle 11.1.0 version of libomp into the Python wheel. This solution is known to work in the presence of other packages (https://github.com/scikit-learn/scikit-learn/pull/21227#issuecomment-933001394), and it's battle-tested.
In the long term, we need a robust method to keep only one copy of OpenMP runtime running, but for now this workaround is good enough.

some data point, my unit test shows me:
 /Users/yifeliu/venv_3.8/lib/python3.8/site-packages/onnxruntime/capi/_pybind_state.py:14: UserWarning: Cannot load onnxruntime.capi. Error: 'dlopen(/Users/yifeliu/venv_3.8/lib/python3.8/site-packages/onnxruntime/capi/onnxruntime_pybind11_state.so, 2): Library not loaded: /usr/local/opt/libomp/lib/libomp.dylib
    Referenced from: /Users/yifeliu/venv_3.8/lib/python3.8/site-packages/onnxruntime/capi/onnxruntime_pybind11_state.so
    Reason: image not found'.
    warnings.warn("Cannot load onnxruntime.capi. Error: '{0}'.".format(str(e)))

so I install by brew install libomp, it install libomp--14.0.4, it get me "segmentation fault 11"
after ungrade 11.1.0, it works

My solution (8 Jul 2022):

Uninstall all xgboost packages, whether it was installed by conda or pip.

Build libomp from source (the commands from @fractor ):

wget https://raw.githubusercontent.com/chenrui333/homebrew-core/0094d1513ce9e2e85e07443b8b5930ad298aad91/Formula/libomp.rb
brew unlink libomp
brew install --build-from-source ./libomp.rb
brew list --version libomp

Install xgboost using pip. The conda one (v1.5.1) is not working now (I don't know why).


"Undefined variable" with unresolved import

Environment
Visual Studio CodeVersion: 1.33.1
Python Extension Version: 2019.3.6558
OS: Windows 10
Python version: 2.7/3.6
Language Server Version: <IP_ADDRESS>
Actual Behavior
Given the Python script
import clr
from System import String

def foo():
    l = String("foo")
    return String("foo")

if __name__ == "__main__":
    print(foo())

The line from System import String reports the problem "unresolved import 'System' Python(unresolved-import) [2, 6]"
The line return String("foo") reports the problem "Undefined variable: 'String' Python(undefiend-variable) [6, 12]".
Expected Behavior
The "unresolved-import" warning is expected, but the "undefined-variable" is unexpected to me.
Interestingly, l = String("foo") is no problem (with <IP_ADDRESS> [beta], this line is also reported).

I'm seeing the same thing.
Numerous undefined-variable and unresolved-import warnings in the Problems output console with Python Extension Version 2019.3.6558
I don't have those issues with 2019.3.6215

What is your language server version? (The extension and the language server are versioned and updated independently.)

ms-python.python-2019.3.6558
languageServer.0.2.55

Yes, currently unresolved import causes the respective variables not being defined.

We can declare it as unknown type.


apps are restarting again and not working

Steps to reproduce
it worked but after a lag in the app, it is now only showing starting screen only and does not work.

✔ Expected Behavior
not opening afrter lag
❌ Actual Behavior
not working
Other Software
No response
Please specify the version of Windows Subsystem for Android
2311.4000.5.0

i guess too many bugs because they will end support to this project.


Add warning (or throw error) when the dataLength prop is missing

Hi!
I spent some time debugging why our infinite scrolls didn't add content and it turned out that I had missed the dataLength prop. The dataLength prop seems very important and it would be nice to see a warning or an error if it is missing. I'd be happy to submit a PR. What do you think?
Thanks

Oh, sorry to hear that! Although it's mentioned in the docs but throwing an explicit error seems better. PR welcome! :)


fix typo

We will not be encouraging one liner grammatical changes as this is expensive process, thank you for your interest.
CC @mihaimaruseac


[New chain]: Sei Devnet

Chain Name
Sei Devnet
RPC URL
https://evm-rpc.arctic-1.seinetwork.io
The chain must be added to https://chainlist.org/

[X] I confirm that the chain is added to chainlist

After creating the issue, a bot will estimate the required pre-fund and post it in the comments. Please check this checkbox after you send the pre-fund.

[x] I sent the pre-fund in accordance with Github Action's comment

Relevant information

https://chainlist.org/chain/713715
https://github.com/ethereum-lists/chains/blob/master/_data/chains/eip155-713715.json

0x42ffa8d7497923b1cb5363789587b70534a21d2c1caa549023bd0e41c1dd8a23


Specify templates for fn init --runtime=..... outside of the CLI source code

As a function developer I want to specify my own template when creating a new function so that I can provide reduce the amount of boilerplate updating.
As an FDK developer I want to not have my FDK coupled to the CLI by the hard-coded project templates in the CLI.
Strawman suggestion for how this could work:

Have each supported runtime use an "init-image" that the CLI pulls and invokes when generating a new function.
User can specify a different "--init-image=" to plug in their own boilerplate.
The contract for images is to run with some arguments such as function-name (and which others?) and to stream out a tarball of the function template, which the CLI can put in place on disk. The alternative of mounting the directory in is risky because of the difficulty in reliably determining the correct user.

I have previously suggested a configurable Docker image based system with a defined contract between CLI and image so any number of files could be return as part of the template.  @rikgibson did we capture this as issues or just in meeting notes?

Hey @shaunsmith I captured the overall concept as a JIRA, which is where this issue ultimately spawned from. We didn't really get into the nitty gritty though - what's the contract, online vs offline experience, breadth of language support etc.  I'd also like to see the build and run images built by the FDK (I think the Java FDK images already are) and the values of build_image and run_image in func.yaml populated by the FDK based on params supplied to fn init, rather than baking into CLI.

Possible params to configure the boilerplate, other than function-name - class-name, language-version? Others? language-version may or may not entail different boilerplate, certainly different build/run images.

I'll prototype this and see what I find.

We should also think beyond language and support arbitrary init/build/run images so that a team could define a template that matches their project needs or corporate standards, for example.  I had envisioned the CLI supporting registration of "runtimes" which is maintained in the .fn/config.yaml with defaults for supported runtimes.


Error Select is not iterable

I try to use apple_framework from rules_ios and my BUILD file is like this
# BUILD file

ios_xcode_framework_lib(
    name = "AppboyPushStory",
    hdrs = select({
        "//Config:iphone-simulator": glob([
            "AppboyPushStory/AppboyPushStory.xcframework/arm64_i386_x86_64-simulator/AppboyPushStory.framework/Headers/**/*.h"
        ]),
        "//conditions:default": glob([
            "AppboyPushStory/AppboyPushStory.xcframework/ios-arm64_armv7/AppboyPushStory.framework/Headers/**/*.h"
        ]),
    }),
    data = [
        ":AppboyPushStoryResources",
    ],
    enable_modules = True,
    deps = [
        ":AppboyPushStory_VendorFramework",
    ],
)

# lib.bzl

def ios_xcode_framework_lib(**kwargs):
    # remove unsed arguments
    kwargs = remove_unused_xcode_framework_args(["enable_modules", "umbrella_header"], **kwargs)

    name = kwargs.pop("name", "")
    module_name = kwargs.pop("module_name", name)

    name = name + XCODE_LIB_SUFFIX

    public_headers = kwargs.pop("hdrs", [])
    deps = add_deps_suffix(kwargs.pop("deps", []))
    # deps = kwargs.pop("deps", [])
    print(name + " have deps: " + "*".join([str(item) for item in deps]) + ": end deps")

    apple_framework(
        name = name,
        module_name = module_name,
        visibility = ["//visibility:public"],
        public_headers = public_headers,
        deps = deps,
        platforms = {"ios": MINIMUM_OS_VERSION},
        **kwargs
    )

but when i try to build the library i got error like this, i still don't know how to fix this
ERROR: Traceback (most recent call last):
	File "/Users/dwi.herdinanto/ios-product/project/Pods/Appboy-Push-Story/BUILD", line 5, column 13, in <toplevel>
		ios_objc_lib(
	File "/Users/dwi.herdinanto/ios-product/project/bazel/ios_lib.bzl", line 13, column 28, in ios_objc_lib
		ios_xcode_framework_lib(**kwargs_copy)
	File "/Users/dwi.herdinanto/ios-product/project/bazel/ios_lib.bzl", line 76, column 20, in ios_xcode_framework_lib
		apple_framework(
	File "/private/var/tmp/_bazel_dwi.herdinanto/cace77b040ff6b91b67f77326ff7816f/external/build_bazel_rules_ios/rules/framework.bzl", line 97, column 28, in apple_framework
		library = apple_library(
	File "/private/var/tmp/_bazel_dwi.herdinanto/cace77b040ff6b91b67f77326ff7816f/external/build_bazel_rules_ios/rules/library.bzl", line 487, column 29, in apple_library
		objc_hdrs = [f for f in public_headers if f.endswith((".inc", ".h", ".hh", ".hpp"))]

Error: type 'select' is not iterable

i'm stuck and need help to resolve this issue

Attributes like srcs & public_headers need to be iterable for the rules_ios macros to function. I'd suggest using something like https://github.com/bazel-ios/cocoapods-bazel to generate the declaration for this type of a dependency.
For example, in your case, it'd look something like this:
apple_framework(
    name = "Appboy-Push-Story",
    module_name = "Appboy_Push_Story",
    platforms = {"ios": "10.0"},
    resource_bundles = {"AppboyPushStory": glob(
        ["AppboyPushStory/Resources/**/*"],
        exclude_directories = 0,
    )},
    vendored_xcframeworks = [
        {
            "name": "AppboyPushStory",
            "slices": [
                {
                    "identifier": "ios-arm64_i386_x86_64-simulator",
                    "platform": "ios",
                    "platform_variant": "simulator",
                    "supported_archs": [
                        "arm64",
                        "i386",
                        "x86_64",
                    ],
                    "path": "AppboyPushStory/AppboyPushStory.xcframework/ios-arm64_i386_x86_64-simulator/AppboyPushStory.framework",
                    "build_type": {
                        "linkage": "static",
                        "packaging": "framework",
                    },
                },
                {
                    "identifier": "ios-arm64_x86_64-maccatalyst",
                    "platform": "ios",
                    "platform_variant": "maccatalyst",
                    "supported_archs": [
                        "arm64",
                        "x86_64",
                    ],
                    "path": "AppboyPushStory/AppboyPushStory.xcframework/ios-arm64_x86_64-maccatalyst/AppboyPushStory.framework",
                    "build_type": {
                        "linkage": "static",
                        "packaging": "framework",
                    },
                },
                {
                    "identifier": "ios-arm64_armv7",
                    "platform": "ios",
                    "platform_variant": "",
                    "supported_archs": [
                        "arm64",
                        "armv7",
                    ],
                    "path": "AppboyPushStory/AppboyPushStory.xcframework/ios-arm64_armv7/AppboyPushStory.framework",
                    "build_type": {
                        "linkage": "static",
                        "packaging": "framework",
                    },
                },
            ],
        },
    ],
    visibility = ["//visibility:public"],
)

You can pass this to your underlying rule if you need to do mutations there via this in your Podfile:
plugin 'cocoapods-bazel', {
  rules: {
    'apple_framework' => { load: '//:lib.bzl', rule: 'ios_xcode_framework_lib' }.freeze,
  }.freeze,
}

hmm,, it seems work
but how about this
load("@build_bazel_rules_ios//rules:precompiled_apple_resource_bundle.bzl", "precompiled_apple_resource_bundle")
load("//bazel:ios_lib.bzl", "ios_objc_lib", "ios_swift_lib", "ios_apple_lib")

ios_apple_lib(
    name = "DeveloperSettings",
    srcs = glob([
        "DeveloperSettings/**/*.m",
        "DeveloperSettings/**/*.swift",
    ]),
    hdrs = glob([
        "DeveloperSettings/**/*.h",
    ]),
    objc_copts = [
        "-I$(BINDIR)/Modules/DeveloperSettings",
    ],
    sdk_frameworks = [
        "Combine",
        "SwiftUI",
        "UIKit",
    ],
    data = [
        ":DeveloperSettingsResources",
    ],
    deps = [
        "//Modules/AppSharing:AppSharing",
        "//Modules/TVLKit"
    ] + select({
        "//Config:release": [],
        "//conditions:default": ["//Pods/FLEX:FLEX"],
    }),
)

so i should create 2 ios_apple_lib?

I'm not sure what you're asking. Can you clarify the question a bit?

Please reopen if this is still an issue.


SuperH: Delay slot fix for bf/s and bt/s

Code now caches the value of $(T_FLAG) before executing the delay slot. Previously the instruction executed in the delay slot could potentially change the value of $(T_FLAG) and thereby resulting in incorrect behavior. Credit to Slinga and Waterfuell from SegaXtreme for reporting the issue.

I made another pass through all of the delay slot instructions. I think I fixed issues in jmp and jsr. Please review and let me know what you think. Thanks.

Fixed by e21149816cc4469b2f824bbba74692431456c486


Handle removed nodes in image preloading

Handle removed nodes in image preloading.
Fix problems when doing preloading in a very large or automatically resized cluster.
/cc @mborsz

/lgtm


Schema changes required

I would like to not make a schema modification for a field for steamId and use the already existing providerAccountId.
https://github.com/Nekonyx/next-auth-steam/blob/3fee1f0465ad55d112167074e4ca2db23e66829b/src/steam.ts#L85

Hi, can you explain exactly what needs to be done and why it needs to be done?

Hi, can you explain exactly what needs to be done and why it needs to be done?

When using Steam Provider it requires changing the schema of the database to add steamID column in the accounts , I would want to not do that, and use already existing field providerAccountId.

And do you want to replace steamId with providerAccountId, or remove it completely?


Align - codec versions

Currently, there are two dependencies in substrate that have differing codec versions from the otherwise used version = 3.0.0

https://github.com/paritytech/substrate/blob/1b1a5e12c0e391c7ed4e3ffa332eb2fe928d257f/frame/conviction-voting/Cargo.toml#L17-L20
https://github.com/paritytech/substrate/blob/1b1a5e12c0e391c7ed4e3ffa332eb2fe928d257f/primitives/io/Cargo.toml#L19

Would it be possible to align those?
We are currently running on version = 3.0.0 so that we are compatible with substrate.

But on our side cargo resolves the codec depdency to: version = 3.1.5
On the Substrate side cargo resolves the codec dependency to version = 3.1.3
which crashes our trait compatablilty.

Is there a reason these two versions need to differ from the "default" version? Would it be possible to align the versions?

@kianenigma @shawntabrizi

which crashes our trait compatablilty.

What you mean by this?
These are all compatible versions to each other, so you can use 3.1.5 downstream.

But are distinct traits from a compiler perspective.
Example
use frame_support::traits::fungibles::Inspect;

type CurrencyOf<T> =
		<<T as Config>::Tokens as Inspect<<T as frame_system::Config>::AccountId>>::AssetId;

pub Config: frame_system::Config
{
    type Tokens: Inspect<Self::AccountId>;
}

#[pallet::Storage]
pub type Dummy<T: Config> =
      StorageMap<_, Blake2_128Concat, u32, CurrencyOf<T>>;

will not compile as my MaxEncodedLen is not equal to Substrates MaxEncodedLen. I can of course bound the AssetId to my local MaxEncodedLen.
I think my main interest was, why different codec versions across Substrate and if we should adapt to that.

Maybe it's also just a local setup thing, why my machine does not agree on a common compatible version between Susbtrate and Centrifuge. TBH it is not important enough to waste our times here, so I will close this.

I think my main interest was, why different codec versions across Substrate and if we should adapt to that.

As I said above, the versions should all be represented by one in your downstream project. That is how semver works.


Convert national unity

See the discussions below for ideas:
https://forum.paradoxplaza.com/forum/index.php?threads/the-vic2-to-hoi4-converter-project-development-thread.915440/page-28#post-21688924
https://forum.paradoxplaza.com/forum/index.php?threads/the-vic2-to-hoi4-converter-project-development-thread.915440/page-28#post-21690653
https://forum.paradoxplaza.com/forum/index.php?threads/the-vic2-to-hoi4-converter-project-development-thread.915440/page-28#post-21692784

(10 - consciousness) * (10 - militancy) should do the trick.
However, it is better to set a minimum of 50% NU and a maximum of 90% NU, to avoid weird results.

According to this repository, we used a system in HoI3. Maybe we should recycle it?

National unity is set at 70 + revanchism * 20 - war_exhaustion / 2.5

https://github.com/Idhrendur/paradoxGameConverters/wiki/Vic2-To-HoI3:-National-Unity

Yep, that code is still there, in fact! But I need to make sure that it puts NU in a realistic range for HoI4 and that it properly outputs it.

In Vanilla HoI4, NU can range from 90% (Germany) to 40% (France). I think that code goes better if we change the starting 70 to a 60.

That's a wide range! Is that largely driven via NS, or is it coded that way? And what does the distribution look like?

I think France is more a developer's joke but the range is actually coded so large at start, without any NS involved.
http://www.hoi4wiki.com/Government#National_Unity


Switch default branch from master to main

We should update this repo to use the main branch rather than master.

Yes. We seriously considered making this change last week, but ended up deciding to follow the GitHub's advice to hold off until they roll out tools to make the conversion easy. They are targeting a release before the end of 2020, and we plan to use them right away.


Anchore scanner reference updates STO-7013

…-7013
Harness Developer Pull Request
Thanks for helping us make the Developer Hub better. The PR will be looked at
by the CODEOWNERS.
What Type of PR is This?

[ ] Issue
[ ] Feature
[ ] Maintenance/Chore

If tied to an Issue, list the Issue(s) here:

Issue(s)

House Keeping
Some items to keep track of. Screen shots of changes are optional but would help the maintainers review quicker.

[ ] Tested Locally
[ ] Optional Screen Shoot.

Please check the Execution Link of the Pipeline for the Website Draft URL. This is located in the Preview Step behind the Harness VPN and also is available in #hdh_alerts. E.g Website Draft URL: https://unique-id--harness-developer.netlify.app. Current Draft URL is: https://65afda3b140c9b268fc87ac3--harness-developer.netlify.app


throws an error when comes to several selectors

.trip,
.trip-disabled {
background-color: #eaeaea;
}
Module build failed: ModuleBuildError: Module build failed: TypeError: Cannot read property '0' of null
at getFirst (/.../node_modules/postcss-namespace/index.js:18:45)

omg:fearful:
I don't know well, maybe.
If you like, please give a little more wide info? (code)


Types missing from package with npm install, but not with npm link

TypeScript Version:  3.8.3
Search Terms:
javascript index.d.ts
declare module javascript
Code
/// <reference path="./typedef.js" />

declare module '@sveltech/routify' {
    export * from '@sveltech/routify/runtime/helpers'
    export * from '@sveltech/routify/runtime/store'
    export const Router: import('svelte/internal').SvelteComponent

    global {
        export const $page:ClientNodeApi
        export const $layout:ClientNodeApi
        export const $params:import('./runtime/helpers').ParamsHelper
        export const $leftover:import('./runtime/helpers').LeftoverHelper
        export const $url: import('./runtime/helpers').UrlHelper
        export const $isActive: import('./runtime/helpers').IsActiveHelper
        export const $goto: import('./runtime/helpers').GotoHelper
        export const $beforeUrlChange: import('./runtime/helpers').BeforeUrlChangeHelper
        export const $ready: import('./runtime/helpers').ReadyHelper
        export let $basepath: String
    }
}

declare module '@sveltech/routify/tmp/routes' {
    export const tree: ClientNode
    export const routes: ClientNode[]
}

Expected behavior:
Exports should be available available after installing npm.
Actual behavior:
If I use npm link in Routify and link to it with npm link @sveltech/routify everything works fine, but if I use npm install @sveltech/routify it doesn't work.
With npm install @sveltech/routify

With npm link @sveltech/routify

repository https://github.com/sveltech/routify/blob/typefixes/tsconfig.json

Additionally, this is what the index.d.ts looks like in the local source folder when it's unlinked.

And if I run npm link, it looks like this

Part of me wonders if this is something to do with the fact that you're using ambient module declarations in the global scope https://github.com/sveltech/routify/blob/b0bfb456d32a256590c8b7b9b192f87ec7411526/index.d.ts
Try removing the declare module "..." wrapper and declare it to properly reflect the package's file structure. In other words, your .d.ts and .js should be 1:1 in the way you expect users to import them.

@DanielRosenwasser Thank you for your reply.
Would that be possible in a way that is compatible with Svelte? Svelte compiles myStore = writable({foo: "bar"}) into reactive stores like $myStore.foo === "bar" //true.
Further, Svelte has a key in package.json which it uses as a custom main entry point.

My experience with TS is very limited, so I have no idea if there's a better way of handling it. I'm hoping there is.

My current duct tape solution
Prefix everything with "/typings"

And emit declarations
{
  "compilerOptions": {
    "allowJs": true,
    "declaration": true,
    "declarationDir": "typings",
    "emitDeclarationOnly": true,
    "resolveJsonModule": true,
    "moduleResolution": "Node",
    "rootDirs": ["runtime", "lib"],
    "target": "es6",
    "baseUrl": "./"
  },
  "include": ["**/*.js", "index.d.ts"],
  "exclude": ["node_modules", "**/*.spec.ts", "test", "tmp", "example"]
}

The paradox here is, that if I leave out index.d.ts from includes it doesn't work. If leave it in, I get an error about overwriting source files, next time I run tsc.


Sitewide - Submitting a form after 10 minutes of 'inactivity' causes an exception

Description
When its been too long since you've refreshed the page, your id_token expires. In the background, the server silently redirects to the gccollab login endpoint, validates that the user is still good, and redirects back to Talent Cloud. So far so good. HOWEVER: back at Talent Cloud, it tries to redirect you to where you originally wanted to go - in this case, submitting a form. But submitting is a POST request, and redirects are always GET requests. Trying to hit a POST endpoint with a GET request causes an error.
Steps to Reproduce
Steps to reproduce the behavior:

Go to Manager portal
Log in as a manager
Go to Profile page
Wait 10 minutes without refreshing or changing page
Click save

This issue was related to the third-party (openid) login mechanism. Its not a problem as long as we're doing our own login.


wincred.Set() returns error on success?

Calling keyring.Set() using the wincred backend on Windows10 and it constantly is returning error="The stub received bad data. but subsequent Get() calls returns the saved data.  Hence it seems that I should be ignoring this error?  Not getting any errors with the file or macOS keychain backends.
Using keyring v1.1.6

So this actually appears to be more serious than a fake error- the data is actually getting truncated to ~2500 bytes.  Curious if anyone keyring is interested in automatically sharding values or if this would be considered out of scope and users of the library should do it themselves?


error with ipex-llm langchain integration for LLAVA model

Hi,
I saved the LLAVA model in 4bit using generate.py from:
https://github.com/intel-analytics/ipex-llm/tree/main/python/llm/example/CPU/PyTorch-Models/Model/llava
model = optimize_model(model)
#Added these lines below in the generate.py
if SAVE_PATH :
model.save_low_bit(save_path_model)
tokenizer.save_pretrained(save_path_model)
print(f"Model and tokenizer are saved to {save_path_model}")
Then used the low bit saved model  in Langchain.
from ipex_llm.langchain.llms import TransformersLLM
model_path = <>
print (" loading IPEX_LLM_Model")
ipex_llm_model = TransformersLLM.from_model_id(
model_id=model_path,
model_kwargs={"temperature": 0, "max_length": 1024, "trust_remote_code": True},
)
I am getting this error:
miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32
2024-06-17 18:40:44,748 - WARNING - /home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/langchain/_api/module_import.py:92: LangChainDeprecationWarning: Importing enforce_stop_tokens from langchain.llms is deprecated. Please replace deprecated imports:

from langchain.llms import enforce_stop_tokens

with new imports of:

from langchain_community.llms.utils import enforce_stop_tokens
You can use the langchain cli to automatically upgrade many imports. Please see documentation here https://python.langchain.com/v0.2/docs/versions/v0_2/
warn_deprecated(

2024-06-17 18:40:44,750 - WARNING - BigdlNativeLLM has been deprecated, please switch to the new LLM API for sepcific models.
loading IPEX_LLM_Model
Traceback (most recent call last):
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/ipex_llm/langchain/llms/transformersllm.py", line 138, in from_model_id
model = AutoModelForCausalLM.from_pretrained(model_id, load_in_4bit=True,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/unittest/mock.py", line 1378, in patched
return func(*newargs, **newkeywargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/ipex_llm/transformers/model.py", line 351, in from_pretrained
model = cls.load_convert(q_k, optimize_model, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/ipex_llm/transformers/model.py", line 494, in load_convert
model = cls.HF_Model.from_pretrained(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 526, in from_pretrained
config, kwargs = AutoConfig.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1098, in from_pretrained
config_class = CONFIG_MAPPING[config_dict["model_type"]]
~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 795, in getitem
raise KeyError(key)
KeyError: 'llava_llama'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "rag-bigdl-main/rag_multimodal_no_summary.py", line 39, in
ipex_llm_model = TransformersLLM.from_model_id(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/ipex_llm/langchain/llms/transformersllm.py", line 141, in from_model_id
model = AutoModel.from_pretrained(model_id, load_in_4bit=True, **_model_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/unittest/mock.py", line 1378, in patched
return func(*newargs, **newkeywargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/ipex_llm/transformers/model.py", line 351, in from_pretrained
model = cls.load_convert(q_k, optimize_model, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/ipex_llm/transformers/model.py", line 494, in load_convert
model = cls.HF_Model.from_pretrained(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 526, in from_pretrained
config, kwargs = AutoConfig.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1098, in from_pretrained
config_class = CONFIG_MAPPING[config_dict["model_type"]]
~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ceed-user/miniforge3/envs/ipex-llm-cpu/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 795, in getitem
raise KeyError(key)
KeyError: 'llava_llama'
What should be the right way to use the saved 4bit LLAVA model in Langchain?

As ipex_llm.langchain.llms.TransformersLLM does not support load LLaVA directly,  you could follow these steps instead.

Please following LLaVA repo guide to load the model
Optimize the model by using ipex_llm.optimize_model() to transform it to low-bit.
Integrate with TransformersLLM by passing it as parameter model so that you could use it in langchain.
Example code:

from ipex_llm import optimize_model

# Load the pretrained model.
# Adapted from LLaVA.llava.model.builder.load_pretrained_model.
def load_pretrained_model(model_path, model_base, model_name, load_8bit=False, load_4bit=False,
                          device_map="auto", device="cpu"):

    # Refer LLaVA repo to load model
    ......
model = optimize_model(model)
from ipex_llm.langchain.llms import TransformersLLM
llm = TransformersLLM(model_id="",model=model,tokenizer=tokenizer)

@ivy-lv11 thank you ! This works!
Finally, I want to use the llm in the RAG pipeline. Using the llm = TransformersLLM(model_id="",model=model,tokenizer=tokenizer), is not generating any output for me. My code uses base64 encoded image as input, as this is the way Ollama works and my solution works with LLaVA model from Ollama. Now I am trying to use Ipex-LLM LLaVA  model instead from Ollama.  Here is my code:
Create chroma
vectorstore = Chroma(
collection_name="mm_rag_clip_photos", embedding_function=OpenCLIPEmbeddings(), persist_directory= "./chroma_test_ipex_llm/"
)
vectorstore.persist()
Get image URIs with .jpg extension only
image_uris = sorted(
[
os.path.join(output_folder, image_name)
for image_name in os.listdir(output_folder)
if image_name.endswith(".png")
]
)
with open (text_path, 'r') as textfile:
texts = textfile.readlines()
Add images
vectorstore.add_images(uris=image_uris)
Add documents
vectorstore.add_texts(texts=texts)
Make retriever
retriever = vectorstore.as_retriever(search_kwargs={"k": 1})
def resize_base64_image(base64_string, size=(128, 128)):
"""
Resize an image encoded as a Base64 string.
Args:
base64_string (str): Base64 string of the original image.
size (tuple): Desired size of the image as (width, height).

Returns:
str: Base64 string of the resized image.
"""
# Decode the Base64 string
img_data = base64.b64decode(base64_string)
img = Image.open(io.BytesIO(img_data))

# Resize the image
resized_img = img.resize(size, Image.LANCZOS)

# Save the resized image to a bytes buffer
buffered = io.BytesIO()
resized_img.save(buffered, format=img.format)

# Encode the resized image to Base64
return base64.b64encode(buffered.getvalue()).decode("utf-8")

def is_base64(s):
"""Check if a string is Base64 encoded"""
try:
return base64.b64encode(base64.b64decode(s)) == s.encode()
except Exception:
return False
def split_image_text_types(docs):
"""Split numpy array images and texts"""
images = []
text = []
for doc in docs:
doc = doc.page_content  # Extract Document contents
if is_base64(doc):
print (" found image doc ")
# Resize image to avoid OAI server error
images.append(
resize_base64_image(doc, size=(250, 250))
)  # base64 encoded str
else:
text.append(doc)
return {"images": images, "texts": text}
def prompt_func(data_dict):
# Joining the context texts into a single string
formatted_texts = "\n".join(data_dict["context"]["texts"])
messages = []

# Adding image(s) to the messages if present
if data_dict["context"]["images"]:
    for x in data_dict["context"]["images"]:
        image_message = {
            "type": "image_url",
            "image_url": f"data:image/jpeg;base64,{x}",
        }
        messages.append(image_message)

# Adding the text message for analysis

text_message = {
    "type": "text",
    "text": (
        "\n You are an AI Assistant for summarizing videos.\n"

    ),
}

messages.append(text_message)

return [HumanMessage(content=messages)]

RAG pipeline
chain = (
{
"context": retriever | RunnableLambda(split_image_text_types),
"question": RunnablePassthrough(),
}
| RunnableLambda(prompt_func)
| llm
| StrOutputParser()
)
d = chain.invoke("what are the key takeaways from the images?")
Please could you help. How do I format the image and text input for the model?

Hi, we will try to reproduce your error.

hi @lzivan could you please let me know if you have any update. Thank you very much.

Hi @tsantra , we are now debugging the "load_image" issue, will get back to you once we have a solution.

hi @lzivan Could you please let me know if there is any update? thanks a lot!

We are still getting "nobody knows" for the output. I'm not sure whether Llava is compatible with Langchain.

We tried on our RTX machine, using local Llava-1.5-7b model, still get the same "nobody knows" output.

@lzivan LlaVA works fine with Langchain using Ollama. So LLaVA is compatible.

@lzivan  what is the "nobody knows" output?

@lzivan LlaVA works fine with Langchain using Ollama. So LLaVA is compatible.

If (official) Ollama works okay, could you please try use IPEX-LLM enabled Ollama on GPU and see if it works?
For how to install IPEX-LLM enabled Ollama and run ollama serve on GPU (e.g. iGPU and Arc), refer to the guilde at this link
Ipex-llm enabled Ollama is used the same way as offical ollama, so you don't have to change your langchain code. Just remember to change the base_url if you're running ollama serve on another machine. For example, if you're running Ollama serve on your_machine_ip, set the ollama base_url as below.
llm = Ollama(
    base_url =  'http://your_machine_ip:11434',
    model="llava"
)

@shane-huang  does it work only on GPU with Ollama? Also, one of the reasons I do not want to continue with Ollama is it seems unstable in performance. The official Ollama.

Hi @tsantra , would you please append the image and the textfile you are using?


useGeneratedKeys=true seems not working properly with sybase ase 15.7

Bug report?
Please fill out the BUG REPORT FORM below.
To fix a bug, we need to reproduce it first.
And we spend a lot of time just trying to reproduce the reported problem, so please consider creating a failing test case or an example project.

How to create a test case : https://github.com/mybatis/mybatis-3/wiki/Unit-Test
How to create a good example : http://sscce.org
How to upload your project to GitHub: https://help.github.com/articles/adding-an-existing-project-to-github-using-the-command-line/

Feature request?

Please delete the BUG REPORT FORM below and describe the feature.
It is a good idea to discuss your changes on the mailing list to get feedback from the community. http://groups.google.com/group/mybatis-user
If you have a patch with unit tests, send a pull request. Please see the wiki page : https://github.com/mybatis/mybatis-3/wiki/Contribute
-->

MyBatis version
3.4.5
Database vendor and version
1> select @@version
2> go

Adaptive Server Enterprise/15.7/EBF 25127 SMP SP136 /P/x86_64/Enterprise Linux/ase157sp136x/3955/64-bit/FBO/Mon Oct 19 19:12:00 2015
Test case or example project
1> create table test(tid int identity not null, tname varchar(30) null)
2> go
Mapper:
public interface TestMapper {
void test(Test t);

}
junit test case
@Test
public void gg(){
bean.Test t = new bean.Test();
t.setName("abcd");
mapper.test(t);
}
bean:
public class Test {
private int id;
private String name;
public Test(){}
public int getId() {
    return id;
}
public void setId(int id) {
    this.id = id;
}
public String getName() {
    return name;
}
public void setName(String name) {
    this.name = name;
}

}
xml:

<resultMap type="bean.Test" id="testmap">
    <id property="id" column="ID" />
    <result property="name" column="NAME" />
</resultMap>
<insert id="test"  parameterType="bean.Test" useGeneratedKeys="true">
insert into test values(#{name})
</insert>

Steps to reproduce
run test case
Expected result
get the generated id in test.id
Actual result
Caused by: java.sql.SQLException: JZ0NK: Generated keys are not available because either the Statement.NO_GENERATED_KEYS was used or no keys were automatically generated.

if use xml as the following, the generated key is always 0

<resultMap type="bean.Test" id="testmap">
    <id property="id" column="ID" />
    <result property="name" column="NAME" />
</resultMap>
<insert id="test"  parameterType="bean.Test" useGeneratedKeys="true">
insert into test values(#{name})
<selectKey resultType="java.lang.Integer" keyProperty="id">
 select @@identity as id
</selectKey>
</insert>

in PreparedStatementHandler.java
@Override
public int update(Statement statement) throws SQLException {
PreparedStatement ps = (PreparedStatement) statement;
ps.executeUpdate();// the original is ps.execute(); i change it to executeUpdate()
int rows = ps.getUpdateCount();
Object parameterObject = boundSql.getParameterObject();
KeyGenerator keyGenerator = mappedStatement.getKeyGenerator();
keyGenerator.processAfter(executor, mappedStatement, ps, parameterObject);
return rows;
}
it seems the useGeneratedKeys works fine

Hi @yaoweijq ,
You don't use useGeneratedKeys and <selectKey /> in a single statement.
Please read the documentation.
You can check if the driver supports getGeneratedKeys() or not with a simple program like the following.
import java.sql.*;

public class SupportsGetGeneratedKeys {
  public static void main(String[] args) throws Exception {
    Class.forName("com....");
    Connection con = DriverManager.getConnection("jdbc:...", "username", "pw");
    System.out.println(con.getMetaData().supportsGetGeneratedKeys());
    con.close();
  }
}

@harawata
if the xml like this:

<resultMap type="bean.Test" id="testmap">
    <id property="id" column="ID" />
    <result property="name" column="NAME" />
</resultMap>
<insert id="test"  parameterType="bean.Test">
insert into test values(#{name})
<selectKey keyProperty="id" order="AFTER" resultType="Integer">select @@IDENTITY as id</selectKey>
</insert>

the returned identity id is always 0

@harawata i have checked the sybase ase driver
if use statement.execute()
the getGeneratedKeys method will throw exception metioned in my first post in this issue
if use statement.executeUpdate()
the getGeneratedKeys will work properly

i have found one bad workaround...

<resultMap type="bean.Test" id="testmap">
    <id property="id" column="ID" />
    <result property="name" column="NAME" />
</resultMap>
<select id="test"  parameterType="bean.Test" resultType="Integer">
insert into test values(#{t.name})
select @@IDENTITY as id
</select>

Why don't you post a question to the mailing list?
There might be someone who has done it with Sybase before (I haven't).
Be sure to include the driver information (vendor, version).

thanks for you suggestion
i will refer to the mailing list

@harawata
i guess this issue is a bug due to either sybase company or mybatis :)

@yaoweijq
I checked your post, but there is no information about the driver.
Which JDBC driver are you using? (vendor, version)
And just to be clear, when you run the program I posted, it prints 'true', is that correct?

@harawata
sorry for missing reply about the program you posted.
the result is true, is correct
the jdbc driver is jconn4.jar
the related information:
Manifest-Version: 1.0
Created-By: 1.6.0_03 (Sun Microsystems Inc.)
Main-Class: SybVersion
Name: com/sybase/jdbcx/
Implementation-Vendor: "Sybase, Inc."
Specification-Title: "jConnect for JDBC 4.0"
Implementation-Title: "com.sybase.jdbcx"
Implementation-Version: "Build (26502)"
Specification-Version: "7.0"
Specification-Vendor: "Sybase, Inc."
and i think i have already got the key information as:
in PreparedStatementHandler.java
@override
public int update(Statement statement) throws SQLException {
PreparedStatement ps = (PreparedStatement) statement;
ps.executeUpdate();// the original is ps.execute(); i change it to executeUpdate()
int rows = ps.getUpdateCount();
Object parameterObject = boundSql.getParameterObject();
KeyGenerator keyGenerator = mappedStatement.getKeyGenerator();
keyGenerator.processAfter(executor, mappedStatement, ps, parameterObject);
return rows;
}
it seems the useGeneratedKeys works fine
as i test with pure jdbc, the behavior is same
if insert statment executed with ps.execute();
the useGeneratedKeys throws Exception
and if executed with ps.executeUpdate()
the useGeneratedKeys works fine as expected

@harawata
i have already contact with sybase support.
if any progress updated, i will share.

Does your database have a trigger?
If yes, please see my comment on #681 .
It's about MS SQL Server, but Sybase and MS SQL Server works similarly (they started from the same product, IIRC) and the same solution might work.

@harawata
the table is newly created by myself
no trigger on it

Okay. Then let's see if someone can help.
There seems to be a free Express edition of SAP ASE (version 16 only?) in case someone has time to look into it.
https://www.sap.com/cmp/syb/crm-xu15-int-asexprdm/index.html

@harawata
sybase support replied
if one preparedstatement prepared with Statement.RETURN_GENERATED_KEYS
and excuted with excute() method
it may be return multi resultset
according to my test
ps.execute();
ps.getMoreResults();
rs = ps.getResultSet();
rs = ps.getGeneratedKeys();
while(rs.next()){
System.out.println(rs.getInt(1));
}
works fine
but
ps.execute();
//ps.getMoreResults();
//rs = ps.getResultSet();
rs = ps.getGeneratedKeys();
while(rs.next()){
System.out.println(rs.getInt(1));
}
will throw
Caused by: java.sql.SQLException: JZ0NK: Generated keys are not available because either the Statement.NO_GENERATED_KEYS was used or no keys were automatically generated.

Hi @yaoweijq ,

sybase support replied
if one preparedstatement prepared with Statement.RETURN_GENERATED_KEYS
and excuted with excute() method
it may be return multi resultset

I am not sure if I understand the meaning of the explanation correctly, but have you tried Tim's suggestion on the mailing list ?
When keyColumn is specified, MyBatis does not set Statement.RETURN_GENRATED_KEYS and it might change the behavior.
Please try it if you haven't.

I installed SAP ASE Express edition.
Adaptive Server Enterprise/16.0 SP03 PL02/EBF 27415 SMP/P/x86_64/SLES 11.1/ase1
	 60sp03pl02x/3096/64-bit/FBO/Fri Oct  6 04:51:57 2017

And verified that useGenerateKeys works if I specify keyProperty.
https://github.com/harawata/mybatis-issues/tree/master/gh-1183
The test worked both with jconn4.jar and jTDS driver.

@harawata
i will try later
thanks

@harawata
thanks very much for your help
i download your project and test with jtds driver and jconn4.jar
if with jtds driver, it works fine
but if with jconn4.jar
the exception throws as before
the different is i use sybase ase 15.7?
or could you please shared you jconn4.jar with me?

Hi @yaoweijq ,
I couldn't find any official statement, but it is not allowed to redistribute jconn4.jar, I think.
I used jconn4.jar installed with SAP ASE Express.
It's also available as part of 'SDK for Adaptive Server Enterprise', it seems (not verified).
https://store.sap.com/sap/cpa/ui/resources/store/html/SolutionDetails.html?pid=0000013451&catID=&pcntry=US&sap-language=EN&_cp_id=id-1417018812660-0
Could you try that please?
Here's MANIFEST.MF of the jconn4.jar that I used to test.
Manifest-Version: 1.0
Implementation-Vendor: Sybase, an SAP Company
Implementation-Title: com.sybase.jdbc4.utils
Implementation-Version: JDK 1.6/jdbcmain/Thu Apr 30 04:18:00 PDT 2015
Specification-Vendor: Sybase, an SAP Company
Built-By: vbabar
Created-By: 1.6.0_03 (Sun Microsystems Inc.)
Specification-Title: jConnect (TM) for JDBC(TM)
Specification-Version: jConnect (TM) for JDBC(TM)/16.0 SP02 (Build 272
 61)/P/EBF24375/JDK 1.6.0/jdbcmain/OPT/Thu Apr 30 04:15:24 PDT 2015
Main-Class: com.sybase.jdbc4.utils.SybVersion

Just to be clear, you need to edit pom.xml and mybatis-config.xml when switching the driver.
Please see the comments in those files.

@harawata
i download and install the sybase ase 16,
and test with jconn4.jar
everything is ok
and i find out that the jconn4.jar i used is not the latest
if i only use jconn4.jar located in sybase ase 15.7
every thing is ok
thanks for you help
good luck:)

Thank you for letting us know the result!


controls: check steer control type

Adds steer control type checking everywhere lateralTuning is checked, since if the steer control type is angle, lateralTuning can be anything, depending on how the car interfaces set it up (pid, angle, lqr).

Handling in the car port for now


Output path respects the hierarchy of the input file. #297

Need to be update before merging. It might help resolve others issues.


fix($timeout): verifyNoPendingTasks() throws even for non-timeout pending tasks

Do you want to request a feature or report a bug?
Bug
What is the current behavior?
ngMock's $timeout.verifyNoPendingTasks() throws if there are deferred tasks that are not related to $timeout.
Reproduction
What is the expected behavior?
ngMock's $timeout.verifyNoPendingTasks() should not throw if there are deferred tasks that are not related to $timeout.
What is the motivation / use case for changing the behavior?
It makes it difficult/unintuitive to test code that uses $timeout wrt pending tasks.
Which versions of Angular, and which browser / OS are affected by this issue? Did this work in previous versions of Angular? Please also test with the latest stable and snapshot (https://code.angularjs.org/snapshot/) versions.
Angular versions: 1.4 and 1.5 (those I tested with, but should affect oldrer versions too)
Browsers: All
Other information (e.g. stacktraces, related issues, suggestions how to fix)
When this method was introduced (back in f0c6ebc), $timeout was probably the only service that used $browser.defer(), so all $browser.deferredFns came from $timeout (thus an non-empty array, meant pending timeouts).
This is no longer the case. E.g. $browser.defer() is used in $evalAsync() and $applyAsync(), which means it transitively used throughout Angular (in watchers, directives etc).

This has been broken for so long, that fixing it should probably be considered a breaking change :disappointed:

Hello @gkalpak
I made a demo to reproduce the error.
So, if I flush a queued function with $timeout and then that queued function makes an HTTP request, which I have to flush with $httpBackend as well, to satisfy the HTTP request expectation in my test, $timeout.verifyNoPendingTasks() fails. If I don't flush the HTTP request, it passes.
I don't know how ngMock works internally, but is seen that a call to $httpBackend.flush(); adds an extra task that $timeout.verifyNoPendingTasks() thinks is related to a $timeout queued function.

@mbarakaja, thx for the demo. So, it is the same issue after all (an unexpected, non-timeout related deferred task, created after $httpBackend.flush()).

The problem in the reproduction by @mbarakaja is that the call to $http.post creates a $q deferred object that in turn adds a new item to the $browser pending tasks queue. It seems wrong to me that the call to $http.flush() does not remove this pending task from the $browser queue.
I think we need to find a way to segment calls to $browser.defer in ngMock so that we can then verify only particular kinds of pending tasks.

That sounds good, @petebacondarwin . I understand it has been this way a long time, @gkalpak, but it still eats dev time when tests involve a combination of $http and $timeout.
I was dealing with an asynch select directive the other day that required both of these mocked in a test and banged my head testing all the cases. I was glad to see this reported already.

Running into this on 1.5.9.  :(

I am curious if you ever fixed this issue? I am running into (what I think) is a similar issue. If I use applyAsync instead of timeout, call verifyNoPendingTask(), then flush, the test would pass as if applyAsync is the same as timeout. Not quite sure how to get around this issue either.

This issue started causing failures in my test suite when upgrading between 1.6.1 and 1.6.2.
I suspect that it may be due to https://github.com/angular/angular.js/pull/14159, which now adds a pending task for any pending route resolves.
Although I don't have a repro to prove this yet, looking at the set of items listed in the 1.6.2 changelog, I'm basing my suspicion on the fact that $route: make asynchronous tasks count as pending requests change sounds like it could be related, given the similar comments above about $http.post creating pending task.
What I can confirm is that if I don't load the ui.router module in my test suite, the test that checks $timeout.verifyNoPendingTasks() starts passing again.  Curiously, even without any $stateProvider states configured (i.e. no routes, and nothing to resolve), the error still occurs if ui.router is loaded.
If, as discussed above, $timeout.verifyNoPendingTasks() is unable to distinguish between these pending resolve tasks and $timeout tasks, then this issue will potentially start to impact more users as they upgrade to 1.6.2 and beyond.
For now, I'm working around the issue by performing an extra preventative $timeout.flush() before my failing test runs.

The $route: make asynchronous tasks count as pending requests part does not affect ui.router, only ngRoute. So, it must be something else that is causing the new behavior.

The $route: make asynchronous tasks count as pending requests part does not affect ui.router, only ngRoute

@gkalpak That is true.
However looking at the commit, there were also some changes made to ngMock/angular-mocks.js; specifically to:

$browser.$$incOutstandingRequestCount() (previously a noop)
$browser.$$completeOutstandingRequest() (previously a noop)
$browser.notifyWhenNoOutstandingRequests()

So it is not only ngRoute that is affected by the change, but also ngMock.
Perhaps ui.router was already doing something similar to what ngRoute  now does (i.e. calling $browser.$$incOutstandingRequestCount()), and since the function is no longer a noop in 1.6.2, the problem arises?
I'll keep looking to see if I can pinpoint what is creating the pending tasks.

These are private methods and external libraries should not be using or relying on them. If ui.router does, then it might indeed cause your tests to break. If it doesn't, then it must be something else.

OK, thanks @gkalpak. I think I've tracked down where the pending task is being created.
The issue seems to be that ui.router.state.$state.$get() immediately creates a rejected promise (which it will later return if it determines the state being transitioned to is no longer current):
function $get($rootScope, $q, $view, $injector, $resolve, $stateParams, $urlRouter, $location, $urlMatcherFactory) {
    var TransitionSupersededError = new Error('transition superseded');
    var TransitionSuperseded = silenceUncaughtInPromise($q.reject(TransitionSupersededError));
    ...
}

It is the call to $q.reject that creates a pending task, i.e.
qFactory.reject() -> qFactory.rejectPromise() -> qFactory.$$reject() -> scheduleProcessQueue(promise.$$state)
scheduleProcessQueue(state) checks if state.status === 2, and if so calls nextTick(processChecks) -> $rootScope.$evalAsync() -> $browser.defer() -> which pushes an item onto $browser.deferredFns making it’s length > 0...hence a pending task.
I'll refer this issue to the ui.router project, and check if they are aware that they're inadvertently creating a pending task by setting up a rejected promise in their provider's $get() function.


Add hydra-core mapping

Maps hydra to hydra-core. Fixes #244.

Coverage remained the same at 88.679% when pulling 537458f2dfb86eb4e77c989ebb488a5a9359fb83 on sxooler:sxooler/patch-hydra into cb4add28efb73cc50892045ad60464e5583d3bfb on bndr:master.

Coverage remained the same at 88.679% when pulling 537458f2dfb86eb4e77c989ebb488a5a9359fb83 on sxooler:sxooler/patch-hydra into cb4add28efb73cc50892045ad60464e5583d3bfb on bndr:master.

Coverage remained the same at 88.679% when pulling 537458f2dfb86eb4e77c989ebb488a5a9359fb83 on sxooler:sxooler/patch-hydra into cb4add28efb73cc50892045ad60464e5583d3bfb on bndr:master.

Coverage remained the same at 88.679% when pulling 537458f2dfb86eb4e77c989ebb488a5a9359fb83 on sxooler:sxooler/patch-hydra into cb4add28efb73cc50892045ad60464e5583d3bfb on bndr:master.

Coverage remained the same at 88.679% when pulling 537458f2dfb86eb4e77c989ebb488a5a9359fb83 on sxooler:sxooler/patch-hydra into cb4add28efb73cc50892045ad60464e5583d3bfb on bndr:master.


Doubt about implementing quick-start (VIME)

Hello @Alcoholrithm !
I am trying to implement VIMELighting following the quickstart guide, but I am facing some problems.
Can you tell me what are the datatypes and expected values of these variables?

categorical_cols
continuous_cols
data

Also, I note that you get the unlabelled data in this code:
X_train, X_unlabeled, y_train, _ = train_test_split(X_train, y_train, train_size = 0.1, random_state=0, stratify=y_train)

Does this mean that I have to merge my labelled and unlabelled data into one dataset before training?
Thank you so much for any clarification!

Hi @McSonk,

categorical_cols and continuous_cols: These should be lists of strings (List[str]), representing the names of the categorical and continuous columns in your pandas DataFrame, respectively.
data (if you mean X_train): This should be a pandas DataFrame containing the input features you want to train on.

Regarding your second question about labeled and unlabeled data:
You do not need to combine them into a single dataset before training. As long as both labeled and unlabeled data are drawn from the same distribution (i.i.d.) and have the same types of features, the method should work correctly.
Note: For more information on the expected types, refer to the type hints in the code. You can also use Python's built-in help function (e.g., help(VIMEDataset)) to review documentation on classes and functions.
Please let me know if you have any further questions!

Thank you so much for your reply!
With data I mean the data object in this method (from the VIME Quickstart):
config = VIMEConfig(
                    task="classification", loss_fn="CrossEntropyLoss", metric=metric, metric_hparams={},
                    embedding_config=embedding_config, backbone_config=backbone_config,
                    predictor_dim=predictor_dim,
                    output_dim=output_dim, alpha1=alpha1, alpha2=alpha2,
                    beta=beta, K=K, p_m = p_m,
                    # Data -> ?
                    cat_cardinality=get_category_cardinality(data, category_cols),
                    num_continuous=len(continuous_cols)
)

If I assume data as X_train, when running trainer.fit(pl_vime, datamodule) I get the error IndexError: Target 3 is out of bounds., which I don't understand since my labels are [1, 0] and I configured output_dim=2.
If it’s not too much trouble, do you have any hints on where I should check to solve this issue?


[META] Add interim form state on form-based modals

Modals should persist their own form state, and only update when users explicitly want to. The following modals should follow this pattern:

[x] source data / ingest docs editor modal #445
[x] input transform modal - #456
[x] output transform modal - #456
[x] query editor modal - #450

Prompt and query override modals leaving for now; these will likely be refactored and/or removed in later changes.

All PRs merged.


Feature request: contextless diffs

The compare window is great but when performing simple  refactoring (e.g. renaming or performing simple transformations) it's common to end up with a large number of modified files where the the diff in each may only be a few sections, each of a single line.  It would be much more convenient to review these changes prior to staging if the "compare" window offered an option to hide or limit the amount common context.
For example in this screenshot, all I'd really like to see is the 4 "Panic" lines (as well as a couple that are are scrolled out of view in the current display mode)

It seems like this ought to be common request but I couldn't find any related issues.  If there are,  please feel free to close as duplicate.

Looks like #3562 but more aggressive in removing context.
When you perform rename refactoring etc. there is preview of changes https://github.com/microsoft/vscode/issues/77728#issuecomment-573559307

Yes, agree it looks very similar.  (Regarding second comment I'm actually using VSCode to review changes made by Resharper in VS Studio, simply because the the VSCode experience is considerably more pleasant !)


Get rid of google meet and zoom option in Newdot

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Slack conversation: https://expensify.slack.com/archives/C0671JDRKQW/p1704216322868449?thread_ts=1703544982.271889&cid=C0671JDRKQW
Problem
We show zoom and google meet in the overflow menu of ever report in NewDot. This unnecessarily leads to us using an overflow menu to store options (which we really wouldn't need without these two options), and the experience itself does not work well. We won't be investing this either, as we're focused on in-app calling.

Solution
Remove these options from NewDot altogether.

Proposal
Please re-state the problem that we are trying to solve in this issue.
Get rid of google meet and zoom option in Newdot
What is the root cause of that problem?
This is an improvement
What changes do you think we should make in order to solve the problem?
We need to remove this code
https://github.com/Expensify/App/blob/8e2fb675389bb84deee4b8e001a536252883e72f/src/components/MoneyReportHeader.js#L139-L154
and
https://github.com/Expensify/App/blob/8e2fb675389bb84deee4b8e001a536252883e72f/src/pages/home/HeaderView.js#L191-L205
We also need to remove icon and translation that is used above
We also should remove VideoChatButtonAndMenu and BaseVideoChatButtonAndMenu Component because we don't use these components any more
What alternative solutions did you explore? (Optional)
NA

Commented in Slack, though to close the loop here, I don't think we should do anything here yet. We're re-designing the details page for all reports, and Call is one of the options.

Cool! I'll hold for now, but if we want to move forward we should get a C+ here to evaluate proposals

Shifting this to monthly if we (currently) don't think we're doing this

Still discussing here but I think we are doing this. Just ironing out details in the thread.

Sounds good! Let me know what the next steps are / if you still need me when you can. Thanks!

@kevinksullivan how are we looking? What should we move forward with?

Sorry for the confusion. We can remove the Google/Zoom options now. There are future initiatives coming that will make changes to our overflow/three-dot menu pattern, though those are coming later and don't need to block this issue.

So I think we can assign @DylanDylann to do this - since they have a proposal ready to go

@shubham1206agra could you take a look at this proposal and let us know if we are good to proceed with it

Proposal
Please re-state the problem that we are trying to solve in this issue.
Need to remove "Zoom" and "Google Meet" options from the Report Header
What is the root cause of that problem?
This is a feature request.
What changes do you think we should make in order to solve the problem?
First, since these options are not needed anymore, we should remove them here:
https://github.com/Expensify/App/blob/45ec86749f9551d154bdd82727828e0f58e71620/src/pages/home/HeaderView.js#L196-L211
https://github.com/Expensify/App/blob/d5eba656251269b238797817df3cf84800b0039a/src/components/MoneyReportHeader.tsx#L93-L108
Second, without these options, the 3-dot menu won't be needed in most cases, as it will only hold the "Pin/Unpin" and sometimes "Join/Leave" options.
Because of this, we should add a check for the length of the 3-dot-menu items. If there are less than some acceptable threshold (1 or 2) items, we should show them directly in the header and not show the 3-dot menu at all (we do a similar thing with the ReportAction context menu).

What alternative solutions did you explore? (Optional)

@DylanDylann's proposal looks good to me.
🎀👀🎀 C+ reviewed

@paultsimura Your suggestion is good, but this will not make a new proposal to be considered.

@DylanDylann your proposal looks good to me too!
@paultsimura just a note: the only sizable difference in your proposal is how to handle the remaining options and in the linked Slack convo (which I know you don't have access to, so no worries!) the team has discussed an alternate approach to this that we'll handle in a later issue. We appreciate the thought though!

Shush @MelvinBot - @DylanDylann this week should be fine to raise the PR, right? Thanks!

I am working on PR, The PR will be ready to review today

@shubham1206agra The PR is ready for review https://github.com/Expensify/App/pull/35844

No regression here, not a bug. Checking off the check list

Ready for payment here @muttmuure!

Handling

@shubham1206agra need you to accept the offer please

Paid up


Add support for configuring retries for pull/push operations

We're currently seeing some flakiness with docker images when both uploading and downloading. It would be great if there was a configuration option to enable exponential backoff retrying.
I'm not sure if you have granular control over a single option, or if all of the docker steps would have to be retried. E.g., I'm pulling a lot of images during a build step and one fails. Would it be possible to retry just that package, or would we need to pull all images again?

Getting started in https://github.com/buildkite-plugins/docker-compose-buildkite-plugin/pull/58.

Done!


(BKR-346) fixed repeat hosts_preserved issue

LGTM

Refer to this link for build results (access rights to CI server needed):
http://jenkins-beaker.delivery.puppetlabs.net//job/qe_beaker_btc-intn/1303/
Test PASSed.


Fixes PWM on TIM1

Closes https://github.com/stm32-rs/stm32f1xx-hal/issues/165
Also, now we update the psc before starting the timers.

Looks great, thanks!


Add caching for transformer inference

Transformer inference (i.e. with no teacher forcing) is slow. In practice I think people typically implement some kind of caching so that at each timestep, we do not need to recompute the embeddings and attentions between all previously decoded timesteps.
I have a quick and dirty implementation of this in an experimental fork, where I basically tell the decoder layer to only get the attention from the most recently decoded target, and all other representations are concatenated on. There are probably other tricks that I can find by e.g. inspecting some huggingface transformers inference code.
I propose adding an option to the transformer encoder decoders to use caching, wherein a CacheTransformerDecoder module is used.
This is a low-priority TODO since we do validation with accuracy, rather than loss, and accuracy can be reliably predicted with teacher forcing if the targets are provided.

So this is an approximation/hack, right? I'm fine with it, and maybe we could treat it as a separate architecture to keep things simple.

So this is an approximation/hack, right?

I don't think so. I think e.g. the attention of t wrt t-1 will always be the same. So caching it is just a memory v. runtime tradeoff. The default is to pass in the full sequence of decoded tokens at every timestep and recompute all of the attentions each time. I will think that through more and test before opening a PR though.

treat it as a separate architecture to keep things simple.

Sure we can do it that way.

So this is an approximation/hack, right?

I don't think so. I think e.g. the attention of t wrt t-1 will always be the same. So caching it is just a memory v. runtime tradeoff. The default is to pass in the full sequence of decoded tokens at every timestep and recompute all of the attentions each time. I will think that through more and test before opening a PR though.

Thanks for clarification. All the better, then.


Can't change equiped item

I just compiled the mod and on Quest 2 controllers I cannot figure out how to equip items and switch between them. I think documenting the bindings would be very beneficial especially for those of us who are lost.

After further investigation I believe this is a bug with this commit. Clicking the joystick shows the menu but it's stuck to your hand so you can't select anything.

The menu you have is a half life alyx inspired menu. You can see it in this devlog: https://youtu.be/sWq2Tl6JJCs?si=2OBXGv7EImwJHQY9
But I agree that some written documentation should be done.

My issue was I have space drag mapped to clicking my joysticks in OVR Advanced Settings, this was my bad


Chore catch error when hash method variant meet valueless_by_exception

Proposed changes
hash method variant may valueless when memory not enough
terminate called after throwing an instance of 'std::bad_variant_access'
  what():  std::visit: variant is valueless
*** Query id: 6a23d37a72684550-b556b16377e1ebe6 ***
*** is nereids: 1 ***
*** tablet id: 0 ***
*** Aborted at<PHONE_NUMBER> (unix time) try "date -d @1715768949" if you are using GNU date ***
*** Current BE git commitID: 533c3ed656 ***
*** SIGABRT unknown detail explain (@0x3eb16a) received by PID 4108650 (TID 4112014 OR 0x7f84c459d700) from PID 4108650; stack trace: ***
 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /home/zcp/repo_center/doris_master/doris/be/src/common/signal_handler.h:421
 1# 0x00007F8942E3D090 in /lib/x86_64-linux-gnu/libc.so.6
 2# raise at ../sysdeps/unix/sysv/linux/raise.c:51
 3# abort at /build/glibc-SzIz7B/glibc-2.31/stdlib/abort.c:81
 4# __gnu_cxx::__verbose_terminate_handler() [clone .cold] at ../../../../libstdc++-v3/libsupc++/vterminate.cc:75
 5# __cxxabiv1::__terminate(void (*)()) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48
 6# 0x000055B16F22B8B1 in /mnt/hdd01/STRESS_ENV/be/lib/doris_be
 7# 0x000055B16F22BA04 in /mnt/hdd01/STRESS_ENV/be/lib/doris_be
 8# doris::pipeline::DistinctStreamingAggLocalState::close(doris::RuntimeState*) at /home/zcp/repo_center/doris_master/doris/be/src/pipeline/exec/distinct_streaming_aggregation_operator.cpp:509
 9# doris::pipeline::OperatorXBase::close(doris::RuntimeState*) in /mnt/hdd01/STRESS_ENV/be/lib/doris_be
10# doris::pipeline::PipelineTask::close(doris::Status) at /home/zcp/repo_center/doris_master/doris/be/src/pipeline/pipeline_task.cpp:418
11# doris::pipeline::_close_task(doris::pipeline::PipelineTask*, doris::Status) at /home/zcp/repo_center/doris_master/doris/be/src/pipeline/task_scheduler.cpp:88
12# doris::pipeline::TaskScheduler::_do_work(unsigned long) at /home/zcp/repo_center/doris_master/doris/be/src/pipeline/task_scheduler.cpp:172
13# doris::ThreadPool::dispatch_thread() in /mnt/hdd01/STRESS_ENV/be/lib/doris_be
14# doris::Thread::supervise_thread(void*) at /home/zcp/repo_center/doris_master/doris/be/src/util/thread.cpp:499
15# start_thread at /build/glibc-SzIz7B/glibc-2.31/nptl/pthread_create.c:478
16# __clone at ../sysdeps/unix/sysv/linux/x86_64/clone.S:97

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall


[TE] Anomaly Feed Implementation

This pull request is a part of the alert redesign. This feed aggregates the candidates from anomaly fetchers, applying filters and output the anomaly results to the next alert component, e.g. grouper. There are several alternative feeds can be designed. The basic one is the union feed. More complicated feed can realize the requirements like anomaly re-alert if anomaly gets more severe, and so on.

Is there a design doc for this?.


Add --fix options

It would appear it's now possible to add --fix options.
See https://github.com/stylelint-scss/stylelint-scss/commit/25d4ae2e980937138eb734321e4ebb3e6d861eb4

Some fixes are now available in the plugin. These are mainly V10 to V11 fixes (where possible) and replacement of pixel/rem sizes with Carbon tokens.


Bench routes CLI

Bench routes CLI is an easy way to get the state of your application in general, removing the hassle of going through the entire dashboard. There wont be graphs or any fancy text, just the status of the application in general.
Note: Users would be able to open BR using the cli

@aquibbaig Can I contribute to this. I have prior experience in working with spf13/cobra package.
Thanks

This is in our GSoC idealist, so if you want to contribute to this, please feel to write a proposal. But prior to that, we recommend contributing in go based issues as per note in idealist.

Thanks


Can you create me a feeder bot?

Hey apos, can you create me a local agario feeder bots that spawn bots that make me bigger? Need as many bots as I can get at least 150. Ready to pay $150 USD = $200 AUD

Anyone willing to help me create an agario suicide/feeder bot with over 150 bots? This needs to be a local script. It would be fine to edit another script such as pulviscriptor's. Will pay a bit of money if you want (but just a bit). Add me on skype to talk about this: Agario-Lord
My GitHub Account: AmazingGamerBoy

Welp, you can't rely on me...
I don't know even the slightest bit of JS.
I only understand how to edit certain lines in a code, with the assistance of others...

My question is why you would pay someone >$100 for bots in a web browser game...

I made a github repo for feeder bots: https://github.com/davidmann4/agario-feeder-bot

@davidmann4 Can that be done on Linux? or just Windows?

both check my repo

I was just wondering if it was the same instructions, looks like it.
On Fri, Feb 26, 2016 at 1:57 PM, David Mann<EMAIL_ADDRESS>wrote:

both check my repo
—
Reply to this email directly or view it on GitHub
https://github.com/Apostolique/Agar.io-bot/issues/460#issuecomment-189423431
.

Well, i created a private server code that has a ability to spawn feeder bots without a client side extention at https://github.com/AJS-development/Ogar-unlimited/tree/master/src

https://github.com/Apostolique/AposFeedingBot


Adding to merge queue triggers required branch protection checks

DEVOPS PULL REQUEST
Related Issue
We want to use a merge queue when merging to main. Once a PR is in the merge queue, it will be put in a merge group (potentially with other PRs, but unlikely if we configure it to require a minimum of 1 PR to start a merge operation). A merge group will only be merged once all required branch protection checks pass, so we have to trigger the workflows that run jobs that have the required checks.
See https://docs.github.com/en/repositories/configuring-branches-and-merges-in-your-repository/configuring-pull-request-merges/managing-a-merge-queue#configuring-continuous-integration-ci-workflows-for-merge-queues
Changes Proposed
Trigger workflows with required checks on the merge_groups event
Testing
Tough to test without me turning on the merge queue functionality first. But the merge queue won't work if we don't add these triggers.

Merge queues are new to me, but I love that we can do this.
Do we need to add this merge_group to the CodeQL, tfsec, and Dependabot Create Issue workflows, too?

I don't think so. None of those workflows complete checks that are required to merge to main. The workflows you listed would still run on pull requests so not sure we need them to run again on the temporary branch generated by the merge queue.

Merge queues are new to me, but I love that we can do this.
Do we need to add this merge_group to the CodeQL, tfsec, and Dependabot Create Issue workflows, too?

I don't think so. None of those workflows complete checks that are required to merge to main. The workflows you listed would still run on pull requests so not sure we need them to run again on the temporary branch generated by the merge queue.

Merge queues are new to me, but I love that we can do this.
Do we need to add this merge_group to the CodeQL, tfsec, and Dependabot Create Issue workflows, too?

I don't think so. None of those workflows complete checks that are required to merge to main. The workflows you listed would still run on pull requests so not sure we need them to run again on the temporary branch generated by the merge queue.

Hmm, tfsec should probably be required to merge, but since it isn't at the moment, this PR LGTM.


Dartium: Implement Isolate methods and spawn parameters for spawnDomUri

Implement Isolate methods

pause
resume
addErrorListener
removeErrorLitener
addOnExitListener
removeOnExitListener
setErrorsFatal
kill
ping
and the Isolate.spawn/spawnUri "paused" parameter.

This probably depends on the VM implementing the features, and then respond to the same out-of-band messages.

Is there any update on this issue? Is "setErrorsFatal" available in Dartium yet?

changing owner to terry

Will not fix.


Adding the verb "Levitate"

The Pull Request resolves Issue #3418
Description:
Definition to the verb "Levitate" has been added.
Its a beautiful word with its one and only definition!!

Please review and merge it!!
and please don't forget to put the Hacktoberfest label ;)
Have good day
Thankyou!
@Showndarya


Support for styling

It would be nice to have some support for styling: e.g.: Change font size etc.

Hi @mariomurrent-softwaresolutions
Thanks for the suggestion. Can you elaborate a bit on how you imagine the styling part?
Because technically, if you don't use the already build widgets but the functions the package provides you have full control over styling anything.

Hi @mariomurrent-softwaresolutions
Thanks for the suggestion. Can you elaborate a bit on how you imagine the styling part?
Because technically, if you don't use the already build widgets but the functions the package provides you have full control over styling anything.

Ah well, yeah I could use the functions. You are totally right. Sorry


[PostgreSQL] Schema permissions is not shown properly

System information:

Operating system (distribution) and version: Windows 10 x64
DBeaver version: 7.0
Additional extensions: -

Connection specification:

Database name and version: PosgtreSQL 11.7
Driver name: PostgreSQL JDBC Driver
Do you use tunnels or proxies (SSH, SOCKS, etc)? No

Describe the problem you're observing:
Properly schema permissions obtaining by SQL:  select * from pg_namespace [WHERE nspname = '<schemaname>'];
Steps to reproduce, if exist:

( https://user-images.githubusercontent.com/31996417/76738352-84826d80-677b-11ea-9d39-0de883f92e08.gif by @uslss )
Include any warning/errors/backtraces from the logs

Fixed.

verified


patched

patched with a site revamp

tried it right now still works

btw get the new update it bypasses the e-mail requirement

thansk


fix: 🐛 release flow

:tada: This PR is included in version 1.0.1 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


webhook: reject excludedIPs change in subnet

Signed-off-by: Bruce Ma<EMAIL_ADDRESS>
Pull Request Description
Describe what this PR does / why we need it
Does this pull request fix one issue?

Describe how you did it
Describe how to verify it
Special notes for reviews

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Related #78


Download latest guard binary without specifying version

As specified in the install guide, we need to specify v0.6.1 while doing a wget to install the guard binary. Is there a way we can download the latest version without specifying the version no. Something like "https://github.com/appscode/guard/releases/download/latest/guard-linux-amd64" would be great as we would not need to keep updating guard version in a automated scenario.

Got the download link. Closing issue


udocker tarball installation questionable

Hi,
I've noticed that the udocker tarball installation behaves oddly:

There are two directories created ~/.udocker/{bin,lib} - both are identical. Guess that can be avoided.
Permissions in both aforementioned dirs prevent the subsequent removal rm -rf ~/.udocker.

This is new in devel branch.

Hi,
Please try with the latest version in devel.

I confirm 1. and 2. as solved!
Thanks for fixing :) Looking fwd to upcoming 1.1.4 is there a estimated deadline?

Thanks for the feedback. Possibly in the beginning of the year.


Parallel controller

Hi there!
Would be great to see the parallel controller by BlazeMeter https://github.com/Blazemeter/jmeter-bzm-plugins/blob/master/parallel/Parallel.md in the DSL

Hello,
Thank you very much for asking for it and taking the time to look into the DSL and creating this issue!
Can you give an example about when you usually use the parallel controller?
What are the key parallel controller properties/features you think the DSL must include in the first release of this feature?
Regards

We use the parallel controller when we need to emulate sending requests in parallel
All the features are needed

Hello,
Might your use case be covered by using downloadEmbeddedResources of httpSampler? Are the parallel requests generated due to embedded resources in a HTML resource and you want to emulate same browser behavior? Or are you simulating client code/API invocation that generates requests in parallel? Might your use case be covered by using separate thread groups?
I ask this questions to keep the API simple, and avoid adding components for use cases that might be covered by existing features. I do see cases where parallel controller is needed, but in most scenarios they are not needed.
Thank you very much for your time and info, hope to hear back from you soon.
Regards

Hm, but for parallel you really can use separeted threads, no?

this is for a case when the client-side of a single user sends the requests in parallel
it's not like embedded resources or so

Thank you very much @EugeneKazakov , we will consider it for next release. Stay tuned.

wow, that was fast, thanks a lot! @rabelenda

We just released another version with improvements on original design of the DSL for parallel controller.


Use v3 for catalog API

Catalog API is now at V3, which is backwards compatible, but enables new features. Addressed by #18.

@rfink Thanks for reporting this. Your PR #18 is now published as version 2.1.0 on npm :smiley:
Let me know if there is anything else related to this that needs to be done. Thanks again!

No, thank you!