Fix intermittently failing tests

The history tests are known to fail intermittently, especially in the cross browser tests.
We should have a go at fixing them so that we have more confidence in our build results.

The last 5 commits have been behaving rather predictably. This issue is anyway an eternal struggle, so it's safe to close.


how can i use the lua script to control the final action?

Describe the bug
hi:
i write the secrule with a lua script as a more accurate detection,howerver, i don't know how to use the lua script to make the deny or pass action as the final action?can you help me
the secrule is as following:
SecRule ARGS "@rx ../" "phase:2,id:113,pass,exec:/usr/local/nginx/conf/file.lua"
the lua script is as following:
local string_find = string.find
local m_getvars = m.getvars
function main()
local get_vars = m_getvars("ARGS",{"lowercase","htmlEntityDecode"})
for _,v in pairs(get_vars) do
if(string_find(v.value,"/etc")) then
return("Suspected attack in variable: " .. v.name .. ".")
end
end
return nil
end
and also i find ,the function of "m.getvars" must appoint the name of the parameter ,such as
local get_vars = m_getvars("ARGS.x",{"lowercase","htmlEntityDecode"})
only this the script can execute successfully ,and i use the version Mod3.x

The return code of yours lua script, will indicate if the disruptive action will take place or not. Another option is to use the ENV variables.


Add test for out-of-order datapoints

Similar to the existing TestAmendDatapointCausesError test, assert
that ErrOutOfOrderSample is returned if we try to append a sample
older than the most recent sample for a given series.

That should return an error I'd say.

superseded in : https://github.com/prometheus/tsdb/pull/387


Enable bidirectional LE Audio TWS

This doesn't look correct.
Ideally you should just cherry-pick
https://github.com/zephyrproject-rtos/zephyr/commit/249d4774f372bdbbea59c485d4c7d0c1a2a7d336
https://github.com/zephyrproject-rtos/zephyr/commit/c8014d181e55604812edf6956d248f836f99a4dc
https://github.com/zephyrproject-rtos/zephyr/commit/36058480e74703334a933bbfe9b4e496e069a0e9
in that order, but this PR has 5 commits, and the last commit seems like it is missing.

This doesn't look correct.
Ideally you should just cherry-pick zephyrproject-rtos/zephyr@249d477 zephyrproject-rtos/zephyr@c8014d1 zephyrproject-rtos/zephyr@3605848
in that order, but this PR has 5 commits, and the last commit seems like it is missing.

@Thalley
Hmmm, to me it looks like the 3 commits you link to are included, and included in that order?
The two other commits are the remaining commits from the same PR as the last commit you link to. I figured it was cleaner to include all commits from a PR. But this might not be the case?

Hmmm, to me it looks like the 3 commits you link to are included, and included in that order?
The two other commits are the remaining commits from the same PR as the last commit you link to. I figured it was cleaner to include all commits from a PR. But this might not be the case?

Yes, my brain read it the opposite direction :D
No, this looks fine. The changes to the samples and babblesim tests could be excluded, but they shouldn't do any harm :)

Rebased on newest sdk-zephyr main

https://github.com/nrfconnect/sdk-nrf/pull/10138
This PR into sdk-zephyr only affects Bluetooth LE Audio.
The CI for the sdk-nrf PR (link) fails for Thread, but this failure has to be caused by something else. The CI for audio passes.


I have added this project on sveltesociety.dev

I opened https://github.com/svelte-society/sveltesociety.dev/pull/202 to add this amazing project on https://sveltesociety.dev/.
Maybe you want to add something to that data?

Cool, thanks :)

PR merged. I can close this.


MutableDictionaryArray rewrite: use values stored in the array instead of the hash->hash map

@ritchie46 @jorgecarleitao Here's one way to fix the incorrect current behaviour of MutableDictionaryArray: only rely on values actually stored in the values array and don't rely on hash-hash maps (due to potential hash collisions).
This is almost a rewrite of the whole thing, outer API aside, and gets pretty evil (self-referential) at the lower level, but I believe it's pretty sound.
There's probably bits and pieces that may need to be cleaned, types and methods to be renamed, potentially some docstrings added etc (comments welcome), but I figured I'd push the current version as soon as it's working so as to figure whether something like this would be acceptable.
Bench-wise, current main (10k dict insertions):
dict_utf8               time:   [239.70 µs 241.27 µs 242.78 µs]
dict_u64                time:   [123.60 µs 123.78 µs 123.98 µs]

This branch:
dict_utf8               time:   [151.54 µs 151.75 µs 151.97 µs]
                        change: [-37.274% -36.837% -36.411%] (p = 0.00 < 0.05)
dict_u64                time:   [42.466 µs 42.522 µs 42.581 µs]
                        change: [-65.705% -65.627% -65.547%] (p = 0.00 < 0.05)

Fixes #1485
Fixes #1554

Clippy errors: can fix in a later PR along with some deps updates.
Miri errors: not sure can prove it to miri here that it's not UB.

Great PR. This could improve grouping performance by low cardinality column data.

@sundy-li you were too fast. I also wanted to review this one. Especially given that MIRI isn't happy. :/

@aldanor I think we can achieve the same with a Hashmap<K, usize> where the usize gets the value in the MutableArray.
IAC This will save a lot of (undsafe) code, and make the values of the hashmap smaller as you don't have two pointers (the ref and the index), but only a single index.
In polars we use that something like this:
        self.inner_map
            .raw_entry_mut()
            .from_hash(hash, |hash_map_key| {
                  let index = hash_map_key.index;

                  self.get_value(index) == insert_value
                }
            })

I think we should go in this direction.

@ritchie46 Sure, sounds like a plan. Tbh I didn't even think of the raw hashmap API since I got too used to the fact that it's nightly-only (but not for hashbrown!).
All the "Indexable" stuff is unfortunately still needed since we have no clean way of connecting "stuff we're pushing" to "stuff we're storing" elsewise.
I'll take a look at the raw hashmap approach now and report back.

(I'll try to look into it asap so maybe don't merge the revert API first, so we don't end up with the same code flipped back and forth 3 times...)

@ritchie46 I think you meant HashMap<usize, K> (as opposed to HashMap<K, usize>) 🙂
But anyways, it does seem to work, I'll push PR shortly.


commands: exclude immature coins from auto-selection

As a follow-up to #873, this adds a comment to make clear that immature coins are not included as candidates for auto-selection excludes immature coins from auto-selection.
An unconfirmed coin could be both immature and marked as change, as the latter only depends on whether the address is derived from the wallet's change descriptor. I've also removed a corresponding assertion that may not always hold.

Thanks for spotting the SQL constraint that I missed and providing the functional test.
As discussed, I've now removed this constraint so that a coin can be both change and immature.
I've also added a DB migration script. I could perhaps perform a check during the migration that SELECT * FROM coins INTERSECT SELECT * FROM coins_new has the same number of rows as coins.

I've updated the coins to use distinct values for each one (amount, vout, derivation index) and added a new coin_e.
I've also added some comments to clarify the approach taken and the final state of the coins.

My bad, i just had a quick skim through the code and overlooked you confirmed them using the connection.

ACK f9bae9cc0814d909a72a800d9f6d7ced2f99f06d -- this is very nice. Again, great catch. And thanks for adding a more extensive unit test.


fix(versions): update Activiti/activiti-cloud-runtime-bundle-service versions into develop

UpdateBot pushed maven dependency: org.activiti.dependencies:activiti-dependencies to: 7.1.112

UpdateBot commands:
updatebot push-version --kind maven org.activiti.dependencies:activiti-dependencies 7.1.112 org.activiti.api:activiti-api-dependencies 7.1.54 org.activiti.core.common:activiti-core-common-dependencies 7.1.62 org.activiti.build:activiti-parent 7.1.28


Failed to install on Mojave Beta

Version

[ ] Version 12

My Problem
got below errors in xcode 9.4.1
Code Signing Error: No account for team "SK24TBMYCC". Add a new account in the Accounts preference pane or verify that your accounts have valid credentials.
Code Signing Error: No signing certificate "Mac Development" found:  No "Mac Development" signing certificate matching team ID "SK24TBMYCC" with a private key was found.

I fixed this by

add an apple account (Personal Team) in xcode
change the certificate settings in both vimari and extension.appex in xcode


[Question]: HOW TO USE LOCAL MODELS IN MultiModalVectorStoreIndex FUNCTION ,WHERE I NEED TO INDEX BOTH IMAGES AND TEXT DATA

Question Validation

[X] I have searched both the documentation and discord for an answer.

Question
`from llama_index.core.indices import MultiModalVectorStoreIndex
from llama_index.core import SimpleDirectoryReader, StorageContext,VectorStoreIndex
import os,cv2
from moviepy.editor import VideoFileClip
from pathlib import Path
import speech_recognition as sr
Replace with the path to your local video file
local_video_path = "./input_video.mp4"
output_folder = "./mixed_data/"
OLLAMA_BASE_URL = "http://localhost:11434"
LOCAL_MODEL = "llama2"
EMBEDDING   = "mistral"
def video_to_images(video_path, output_folder):
cap = cv2.VideoCapture(video_path)
frame_count = 0
while True:
    ret, frame = cap.read()
    if not ret:
        break

    cv2.imwrite(os.path.join(output_folder, f"frame{frame_count:04d}.png"), frame)
    frame_count += 1

cap.release()

def video_to_audio(video_path, output_audio_path):
"""
Convert a video to audio and save it to the output path.
Parameters:
video_path (str): The path to the video file.
output_audio_path (str): The path to save the audio to.

"""
clip = VideoFileClip(video_path)
audio = clip.audio
audio.write_audiofile(output_audio_path)

def audio_to_text(audio_path):
"""
Convert audio to text using the SpeechRecognition library.
Parameters:
audio_path (str): The path to the audio file.

Returns:
test (str): The text recognized from the audio.

"""
recognizer = sr.Recognizer()
audio = sr.AudioFile(audio_path)

with audio as source:
    # Record the audio data
    audio_data = recognizer.record(source)

    try:
        # Recognize the speech
        text = recognizer.recognize_whisper(audio_data)
    except sr.UnknownValueError:
        print("Speech recognition could not understand the audio.")
    except sr.RequestError as e:
        print(f"Could not request results from service; {e}")

return text

def process_video(local_video_path, output_folder):
"""
Processes and extracts information from a local video.
Parameters:
local_video_path (str): The path to the local video file.
output_folder (str): The path to the folder to save the extracted information.

Returns:
dict: A dictionary containing the extracted text and image paths.
"""
output_video_path = os.path.join(output_folder, "video_data/")
output_audio_path = os.path.join(output_folder, "output_audio.wav")
Path(output_folder).mkdir(parents=True, exist_ok=True)

video_to_images(local_video_path, output_folder)
video_to_audio(local_video_path, output_audio_path)
text_data = audio_to_text(output_audio_path)

with open(os.path.join(output_folder, "output_text.txt"), "w") as file:
    file.write(text_data)
print("Text data saved to file")
file.close()
os.remove(output_audio_path)
print("Audio file removed")

return text_data, output_folder

text_data, output_folder = process_video(local_video_path, output_folder)
from llama_index.embeddings.huggingface import HuggingFaceEmbedding
from transformers import CLIPModel, CLIPProcessor
from llama_index.vector_stores.lancedb import LanceDBVectorStore
from llama_index.core import Settings
text_store = LanceDBVectorStore(
uri="lancedb",
table_name="text_collection"
)
image_store = LanceDBVectorStore(
uri="lancedb",
table_name="image_collection"
)
Settings.embed_model = HuggingFaceEmbedding(model_name="sentence-transformers/clip-ViT-B-32-multilingual-v1")
storage_context = StorageContext.from_defaults(vector_store=text_store, image_store=image_store)
Load documents and create multimodal index
documents = SimpleDirectoryReader(output_folder).load_data()
clip_model = CLIPModel.from_pretrained("openai/clip-vit-base-patch32")
image_embed_model = CLIPProcessor.from_pretrained("openai/clip-vit-base-patch32")
index = MultiModalVectorStoreIndex.from_documents(documents, storage_context)`
how to use local models for both images and text data in the above MultiModalVectorStoreIndex.from_documents function

does the code snippet provided by you takes consideration of text embeddings in MultiModalVectorStoreIndex

how can we use any other custom models from huggingface or any other opensource libraries which handles both images and text instead of clip embedding ?


Create Transpose_Matrix.py

Transpose of a matrix in Python #54
=> Takes input and transpose the 2D matrix.

@Aniket762 Hey, what's wrong?
What should I change?

@appsx13 Please remove the example part

@appsx13 Please remove the example part

Done


If i not place #include <GL/OOGL.hpp> statement just before my main function, compiler gives error messages

#include <Garbage.H>
#include <Alert.H>
#include <Game.H>

#include <GL/OOGL.hpp>

int main(void)
{

}

Is okay but i can't do it like that because my libraries need GL namespace and putting include statement above makes compiler give error
In the first statement of Garbage.H, for example, i make few definitions for my personal preferences, like writing Integer instead of int.
 #define Integer int
When i put the include statement above, compiler gives a meaningless error message:
include/Garbage.H:20:17: error: expected ‘)’ before ‘int’
 #define Integer int

Even if i remove the define statement, it gives the a similar error from another file. What is the problem?

Can you upload your Garbage.H file somewhere?


Microsoft teams

Description
add Microsoft Teams as notification channel type
Issues Resolved
#585
Check List

[ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

PR in common-utils: https://github.com/opensearch-project/common-utils/pull/428

tests depending on the PR in common-utils https://github.com/opensearch-project/common-utils/pull/428


Date picker includes time

Bug Report
Description
On https://engineering.cerner.com/terra-ui/#/components/terra-date-picker/date-picker/date-picker, whenever I manually type in a date or select from the calendar, the date value returned in the onChange callback contains a time component. As a date only picker, we should only return the date portion of the ISO 8601 spec. It is perfectly fine for an ISO 8601 string to contain only the date portion.
If some application needs to send the value back to an API with time value, then that is it's responsibility. It should not be expected of everyone using the component to chop off the time component.
Steps to Reproduce

Go to https://engineering.cerner.com/terra-ui/#/components/terra-date-picker/date-picker/date-picker
Manually enter a date
Select a date from the calendar
Value returned by component is 2019-07-27T00:00:00-05:00 or 2019-07-22T15:02:27-05:00 if time value originally given in value prop.

Additional Context / Screenshots
Expected Behavior
Date value only appears as YYYY-MM-DD. No time portion exists.
Possible Solution
Remove the time component when returning the value in any callback. From talking with @mmalaker he agreed it was strange that the time value was being returned.
Environment

Component Name and Version: terra-date-picker
Browser Name and Version: Chrome
Node/npm Version:
Webpack Version:
Operating System and version (desktop or mobile):

@ Mentions

While fixing this, it is worth taking a look at the value in the onSelect callback as well, I think.
https://github.com/cerner/terra-framework/blob/967bf14e99dd0f3f1761f95b6bcb49e393d7304d/packages/terra-date-picker/src/DatePicker.jsx#L202


NDRS-693: Fix incorrect next_finalized on Block Proposer initialization

https://casperlabs.atlassian.net/browse/NDRS-693

bors r+


can't see edges

running standard setup, this is what I see of the network :

$ colony index.js -m && serve colony
seems like the connecting lines have a style which is opacity 0.3
not sure if there's a command i'm missing
love the package, great to use

Same problem. Also, the lines don't seem to have a stroke and therefore won't show. It should be easy to fix by someone familiar with the project.
This hack in the console helps a bit:
var links = document.getElementsByClassName('link');
for(var i = 0; i < links.length; i++) {
var link = links[i];
link.setAttribute('stroke', 'white');
link.setAttribute('style', 'opacity: 1');
}

nice :)
I just did something similar by editing the colony.js then copying that
over the minified js that was being served.
On 11 January 2015 at 00:37, Sven Neumann<EMAIL_ADDRESS>wrote:

Same problem. Also, the lines don't seem to have a stroke and therefore
won't show. It should be easy to fix by someone familiar with the project.
This hack in the console helps a bit:
var links = document.getElementsByClassName('link');
for(var i = 0; i < links.length; i++) {
var link = links[i];
link.setAttribute('stroke', 'white');
link.setAttribute('style', 'opacity: 1');
}
—
Reply to this email directly or view it on GitHub
https://github.com/hughsk/colony/issues/9#issuecomment-69452876.

Hi, had the same problem, my solution was adding the following style to 'node_modules/colony/public/css/colony.css' and rebuild the colony page of course :)
.link {
stroke:white;
}


It still working?

It's a fork from another project? ,,, contratulations, nice job, thank you....  If you need some help, i'm here.

I found a incompatibility or bug, i really confused,
when i use it with https://github.com/mapsplugin/cordova-plugin-googlemaps (it works without this plugin)
Yeah i had made a lot of attempts to build with and whitout this plugin, i made a fork to try with changes, but i dont have success;;;;
i get this error or something very similar to it.
[...]
BUILD FAILED in 37s
Error: /var/gimlet/tmp/47026110071400/3971030/gradlew: Command failed with exit code 1 Error output:
Note: /var/gimlet/tmp/47026110071400/3971030/CordovaLib/src/org/apache/cordova/engine/SystemCookieManager.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
D8: Program type already present: android.support.v4.app.INotificationSideChannel
FAILURE: Build failed with an exception.

What went wrong:
Execution failed for task ':app:transformDexArchiveWithExternalLibsDexMergerForDebug'.

com.android.builder.dexing.DexArchiveMergerException: Error while merging dex archives:
Learn how to resolve the issue at https://developer.android.com/studio/build/dependencies#duplicate_classes.
Program type already present: android.support.v4.app.INotificationSideChannel


Hard coded dependency on "youtube-dl" and the alternative "yt-dlp"

Thank you for your work in this very usefull tool.
I've been testing and comparing a lot of these alternative cli youtube frontends. As of today, invidtui has "youtube-dl" as a mandatory dependency.
Is there any special reason for this ?
yt-dlp is a more updated and maintained fork of youtube-dl. Actually, as of today, it is not the "alternative" to youtube-dl. It is the other way around. It is already an official package in a lot of official Linux distro repositories. I see the other projects supporting both, and the tool just picks up the one you have chosen to have on your system.
I'm on Archlinux, using these recipes to test invidtui, https://aur.archlinux.org/packages/invidtui-bin or https://aur.archlinux.org/packages/invidtui.
For the cases like me, who :

have yt-dlp installed as an official package
dont have youtube-dl installed
dont want to have "youtube-dl" installed,

There's an additional alternative step. You install  and addtional tool like "yt-dlp-drop-in" to "cheat" your system into thinking you have "youtube-dl".
I find it bloated, convoluted and unnecessary.
And I would prefer if the tool (inviditui in this case) would natively supports yt-dlp to start with. Without expecting to find something called "youtube-dl" on your system.
Thanks in advance.

Thank you for opening this issue.
I should have been more clear on the dependencies required. yt-dlp is already permissible by default, all you have to do is to specify that invidtui has to use yt-dlp either via the command-line option --ytdl-path or adding a ytdl-path entry in your config file.
Via command-line, invoking invidtui with the option would look like this:
invidtui --ytdl-path=/usr/bin/yt-dlp
For the config file, use invidtui --help to get the config file location,and within the config file add this line:
ytdl-path=/usr/bin/yt-dlp
The methods listed above are a bit tedious, I agree, and I will add yt-dlp as a switchback in the upcoming release so that the command-line option or the config file entry is not necessary.


Tech Debt: Issue automating gh-pages with github actions

Version
Hardware configuration
Describe the bug
Automating gh-pages with github actions

Mike tool for versioning works with gh-pages.
Only if "Update GH Pages" workflow works then "pages-build-deployment" github action will work which automatically deploy the pages
Update GH Pages workflow is failing with following errors in logs -
INFO    -  Copying '/home/runner/work/automated-self-checkout/automated-self-checkout/docs' to 'gh-pages' branch and pushing to GitHub. [232](https://github.com/intel-retail/automated-self-checkout/actions/runs/7035791815/job/19148502006#step:5:233) remote: Permission to intel-retail/automated-self-checkout.git denied to github-actions[bot]. [233](https://github.com/intel-retail/automated-self-checkout/actions/runs/7035791815/job/19148502006#step:5:234) fatal: unable to access 'https://github.com/intel-retail/automated-self-checkout/': The requested URL returned error: 403 [234](https://github.com/intel-retail/automated-self-checkout/actions/runs/7035791815/job/19148502006#step:5:235) Traceback (most recent call last): [235](https://github.com/intel-retail/automated-self-checkout/actions/runs/7035791815/job/19148502006#step:5:236) File "/opt/hostedtoolcache/Python/3.12.0/x64/bin/mkdocs", line 8, in <module> [236](https://github.com/intel-retail/automated-self-checkout/actions/runs/7035791815/job/19148502006#step:5:237)  sys.exit(cli()) [12:11](https://rsd-intel.slack.com/archives/D012QNL16MC/p1701285090502049) its from the log here - https://github.com/intel-retail/automated-self-checkout/actions/runs/7035791815/job/19148502006

Sent email to intel-retail admin -<EMAIL_ADDRESS>Raised jira ticket - https://opensource.intel.com/jira/servicedesk/customer/portal/1/DIO-15801


Codsworth without voice/conversation delay

Describe the bug
After the vault codsworth has no voice/Conversation don't start until i shoot him
Is it already a known issue?
If so or you are not sure please do not make a new request and see the known issue page. Here
Steps to reproduce
Reloading just before starting the conversation, issue persists
Environment

OS: Windows 10
Hardware
Other details that you think may affect.

Additional context
https://youtu.be/dG_YbiWzQbM

Thank you, being tracked.

Issue has been fixed in new upcoming patch. Unable to reproduce at this point.


Store: Add tenant label to exported metrics

[x] I added CHANGELOG entry for this change.
[ ] Change is not relevant to the end user.

Changes
This PR continues that work done in https://github.com/thanos-io/thanos/pull/6530 and https://github.com/thanos-io/thanos/pull/6595 to implement the "tenancy awareness in query path" proposal.

Enhance relevant Store Gateway metrics with tenant information, in order to facilitate a per tenant view of store usage
Added possibility to add HTTP headers to promclient.QueryOptions in order to create test cases where a tenant is set during querying
Query tenant flags are no longer hidden as we now have some value in setting these
Removed a few of debug log lines in bucket, as these are unnecessary as we now add the tenant information to the metrics

Verification

Added e2e test for a subset of the tenant enhanced metrics

cc: @douglascamata 🙂

@yeya24 I think this feature can be disabled by setting flags on querier/query-frontend, in case the user wants to avoid the extra cardinality. This seems like a useful feature to attribute query path resource cost to a particular tenant.
Maybe we can reconsider some of the metrics, when adding the tenant label later on @jacobbaungard?

@saswatamcode Ah thanks for the clarification. I didn't notice that it can be turned off by setting flags.
But yeah I agree maybe we can revisit those labels at some point and see if they are really necessary.

Currently the tenant information is always propagated from the querier (default-tenant if nothing else is specified), and will be added the these metrics.
If there is a concern about these metrics having the tenant information added by default we could either:

Don't forward the tenant header from the querier unless specifically set. I think this will add a fair bit of complexity to the code though.
As suggested, take a closer look at which metrics specifically needs the tenant information. We'd probably want to ensure we do that before the next release in this case.

Although unless one actually starts querying data with different tenants, there will only be one label added (with the default-tenant value), so it probably shouldn't impact cardinality in this case.


Fixed similar issue with history calls silently dropping params

Probably makes sense to check that all authenticated_post(...) calls are passing params properly...

Thanks again @arvicco. I think there might be a problem with other calls, checking right now.

Looks good


Update Track intersects/intersection to use actual intersection

Add methods for:

all shapes in a track that intersect a provided shape
all shapes in a track that are contained by a provided shape


Out of order list of tags deserialization error

So I basically have some XML in the form:
<states>
  <state />
  <statelist>
    <state />
    <state />
  </statelist>
  <state />
</states>

which fails to deserialize because the tags go state, statelist, state.
However it deserializes fine if the two state tags come first:
<states>
  <state />
  <state />
  <statelist>
    <state />
    <state />
  </statelist>
</states>

To what rust code do you expect it to deserialize? I have no clue how to represent interleaved sequences.

See #26 for a similar/the same case

I expect/prefer for it to deserialize to:
struct States {
    state: Vec<State>,
    statelist: Statelist,
}

struct Statelist {
    vec: State,
}

There can't be multiple state lists?
This is very hard to do, I'll think about it, but it'll require some intermediate allocations.
The easiest would be to manually implement deserialize for this special case

There can be multiple statelists, but I simplified it for the purposes of illustrating the example. Here's the full version of what I want.

The serde deserialization framework does not fit your use case with autogenerated deserialize impls. There's no need for a custom deserializer, since that won't help. You need to implement Deserialize manually for  States.
I'd still say that the solution from #26 is cleaner, but I'm not sure on the usability of the struct and enum

Yeah that's what I meant by "custom deserializer". Ok I'll look into it, thanks.

Actually, I don't think I can use the solution in #26 because my elements don't specify an xsi:type. Is there a way to deserialize those elements to an enum just on their name alone?

Yea, you need to write a MapVisitor to get access to the names

Similar to the generic one here you can simply call a KeyDeserializer to get the name

Well for what's its worth I ended up implementing Deserialize manually and leaving the struct itself as-is. It seems to work. Thank you for your help. I guess this issue can be closed now.


Stop silencing all call-with-block errors

Motivation

Fixes #5605
Test plan

See included automated tests.

We have a policy of testing changes to Sorbet against Stripe's codebase before
merging them. I've kicked off a test run for the current PR.  When the build
finishes, I'll share with you whether or how it failed. Thanks!
Stripe employees can see the build results here:
→ https://go/builds/bui_LTJeQwKgbhyiKg
→ https://go/builds/bui_LTJe9Maj5A8MPG

yeah i'll handle it in this one, just wanted to get something up to run test-pr-on-pay-server before running to an interview. i'll also add tests

Looks good! It looks like the same problem exists for callWithSplatAndBlock. Should we fix that one in a follow-up PR, or would you rather handle it in this one?

The callWithBlock and callWithSplatAndBlock share the same implementation, so the fix only has to happen in one place. I've added tests for both cases.


update contributing.md

make the checkboxes unchecked so the contributors can check them individually

Thanks @zakrid.
If I am not mistaken, GitHub doesn't actually let people check those checkboxes... they are disabled. But let's give it a try.
A couple of things:

[ ] You need a space between the opening and closing brackets.
[ ] You only modified some of the checkboxes, not all of them.


Can you explain why YOLOS-Small has 30 Million parameter while DeiT-S has 22 Million parameter

As the title suggested

Hi @gaopengcuhk, thanks for your interest in our work and good question!
For the small- and base-sized model, the added parameters mainly come from positional embeddings (PE): we add randomly initialized (512 / 16) x (864 / 16) PE at every Transformer layer to align with the DETR settings initially. But later we find that interpolate the pre-trained first layer PE to a larger size, i.e., (800 / 16) x (1344 / 16) can strike a better accuracy & parameter tradeoff. I.e., 36.6 AP v.s. 36.1 AP & 24.6 M (22.1 M + 2.5 M 😄) v.s. 30.7 M (22.1 M+ 8.6 M 😭). The tiny-sized model adopts this configuration.
We have added a detailed description in the Appendix and we will submit it to the arxiv soon (next week, hopefully), the pre-trained model will also be released soon, please stay tuned :)
This issue won't be closed until we update our manuscript on arxiv.

Another question, why only add the prediction head on the last layer? Have you tried to add the prediction head to the last several layers like DETR?

Another question, why only add the prediction head on the last layer? Have you tried to add the prediction head to the last several layers like DETR?

Thanks for your valuable issue.
We have tried this configuration in our early study, which gives no improvements.
The reason we guess is: for DETR, the deep supervision works because the supervision is "deep enough". I.e., the decoders are stacked upon least 50 / 101 layers ResNet backbone and 6 layers Transformer encoders. While YOLOS with a much shallow network cannot benefit from deep supervision.

Another question, it seems like you add the position embedding to x every layer. While in Deit, only the first layer add position embedding, is this important in YOLOS?

Another question, it seems like you add the position embedding to x every layer. While in Deit, only the first layer add position embedding, is this important in YOLOS?

We have actually answered here: https://github.com/hustvl/YOLOS/issues/3#issuecomment-861146608: YOLOS with only first  layer PE added is better in terms of AP and parameter efficiency :)

Thank you very much for your reply.

This issue won't be closed until we update our manuscript on arxiv.

This issue won't be closed until we update our manuscript on arxiv.

We have updated our manuscript on arxiv, and as such I'm closing this issue. Let us know if you have further questions.


Is it possible to create Files VolumeSnapshot for private endpoint storage accounts?

Clarify if it is possible / how to create file snapshots for storage accounts behind private endpoints
I have created a custom storage class pointing to a storage account which has a private endpoint following this guide #use-a-persistent-volume-with-private-azure-files-storage-private-endpoint This works just fine in creating and reading from file shares.
I then added the CRDs, created a volume snapshot class following the guide, seems to work fine. However, when creating a volumesnapshot it seems as somehow this traffic is blocked by the firewall on my storage account ( even though other traffic between my AKS cluster and the file shares work just fine)
  Error:
Message:     Failed to check and update snapshot content: failed to take snapshot of the volume storage#stvolumespzrwrjlb#pvc-
e4c9dedf-3946-4693-ac91-55dbd3b52a80###myapp: "rpc error: code = Internal desc = failed to check if snapshot(snapshot-
5277fa65-89d4-44c7-9139-e65a20d3a4bf) exists: -> github.com/Azure/azure-storage-file-go/azfile.newStorageError,
/mnt/vss/_work/1/go/src/sigs.k8s.io/azurefile-csi-driver/vendor/github.com/Azure/azure-storage-file-
go/azfile/zc_storage_error.go:42\n===== RESPONSE ERROR (ServiceCode=AuthorizationFailure) =====\nDescription=This request is
 not authorized to perform this operation.\nRequestId:491d88e1-001a-005c-788e-c27fcd000000\nTime:2022-09-
07T07:53:49.8957064Z, Details: \n   Code: AuthorizationFailure\n   GET https://mystorageaccount.file.core.windows.net?
comp=list&include=metadata%2Csnapshots&timeout=60\n

Once I open up the storage account firewall to accept all connections, a new snapshot works perfectly.
I also notice that in my storageclass I have to specify a parameter
parameters:
  server: mystorageaccount.file.core.windows.net

this param points to the .privatelink url, while the volumesnapshots tries quering the public endpoint. DNS should make both resolve to the private endpoint, so I am not sure it makes a difference.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: fc6adf61-d0eb-f95c-60a7-bd3e1b52b5a5
Version Independent ID: e1a7cc5d-2988-3c62-5169-48eac7c0fc47
Content: Use Container Storage Interface (CSI) driver for Azure Files on Azure Kubernetes Service (AKS) - Azure Kubernetes Service
Content Source: articles/aks/azure-files-csi.md
Service: container-service
GitHub Login: @palma21
Microsoft Alias: zarhoads

@audunsolemdal
Thanks for your feedback! We will investigate and update as appropriate.

Hello @zr-msft @palma21 , could you please provide your insights on the above ?
Thanks

Anyone?

this issue is fixed in https://github.com/kubernetes-sigs/azurefile-csi-driver/releases/tag/v1.24.0 with https://github.com/kubernetes-sigs/azurefile-csi-driver/pull/1118, before v1.24.0, we are using data plane api taking snapshot, that would be blocked by firewall, and with v1.24.0, we are using management api to take snapshot, it won't be blocked by account firewall. Azure file csi driver version v1.24.0 would be rolled out in AKS in 2023-01-08 release.


Add new symbols for go1.19 compat

When boring was merged into the main branch for go1.19
a few new symbols were added. Adding them into this
repo in order to create our Go 1.19 branch.

Looks good to me. This is basically porting golang/go@0ec0828 and golang/go@fa603aa right?

That's correct.


I am also getting same error while creating routing profiles

Parameter validation failed:
Unknown parameter in input: "NumberOfAssociatedQueues", must be one of: InstanceId, Name, Description, DefaultOutboundQueueId, QueueConfigs, MediaConcurrencies, Tags
Unknown parameter in input: "NumberOfAssociatedUsers", must be one of: InstanceId, Name, Description, DefaultOutboundQueueId, QueueConfigs, MediaConcurrencies, Tags

Thank you @NehaRana03 for your report. I have fixed the issue in version 1.3 and tested successfully on AWS CLI 2.8.6. Please download the new script and try again.


Handling empty arrays

Hello! Under spec (https://jsonapi.org/format/#fetching-resources-responses-200), we have this kind of json possible:
{
  "links": {
    "self": "http://example.com/articles"
  },
  "data": []
}

I believe - unless the changes to library happened recently - the following code will fire and fail:
                is JsonArray -> {
                    val first = jsonElement.jsonArray[0]
                    val type = first.jsonObject[JsonApiConstants.Keys.TYPE]
                    type?.jsonPrimitive?.content!!
                }

Please confirm (or not)  the issue and may be you have ideas re workaround. Thanks!

Hey @oradkovsky!
Thanks for your feedback!
Im currently looking into this issue as we are preparing for a new release soon.
On one hand the JSON:API specification doesn't allow for empty arrays. Null should be sent instead.
However, we are going to make a workaround for this, as lib shouldn't crash on something so simple


Merge Providers branch

The providers branch includes the first Providable item in Symphony, Datasource: Remote. The idea is that this replaces the Dynamic XML datasource so ideally we will need to think of an update strategy for the Dynamic XML datasources for previous versions.
I see two options, one easy (but needs a little backtracking), one potentially more time consuming:

Leave Dynamic XML datasources in 2.3, so that existing ones will continue to work. Datasource: Remote will be available for users who want the 'updated' functionality. Dynamic XML datasources will be deprecated and remove in 2.5.
Attempt to load in all Dynamic XML datasources and resave them as Remote datasources.

The other question is do we bundle Datasource: Remote as a submodule (ie. create a new repo), do we just bundle it in Symphony, or just add it as an extension and leave it up to a user to download it?

Leave Dynamic XML datasources in 2.3, so that existing ones will continue to work. Datasource: Remote will be available for users who want the 'updated' functionality.

This would be my preference. A lot of the time these DSs are customised (in my experience anyway) so I'm not sure how they could be safely updated. Seems like these should be left to function as before, but perhaps marked as deprecated so they still work, but perhaps cannot be editied? Or to edit them they go through a conversion process? But I'm not keen on blindly updating them on upgrade.

Personally, I think that option two is the better for forward thinking, although I can see that option 1 would be better accepted by the community.
When it comes to the extension, for me, it would be a bundled extension like the current set, it gives a good example for developers to use, and as it has always been a feature of Symphony (the DS type I mean) it makes sense to bundle it as a submodule.

My gut is to offer it as a separate extension for that very reason Nick. If we updated all datasources on update, we would respect the allowEditorToParse function. If a developer had set that, then we will still have to support the old Dynamic Datasource code anyway.
I like a separate extension as it's more towards our goal of breaking Symphony out into modules. While this is a bit frustrating at the moment as there are no 'customise your Symphony install' builders (aka jQuery UI/Modernizr), I think in time that will change as there have been various mentions of such things throughout the community.

Makes sense. Could you remove "Dynamic XML" from the choices for creating a new DS, but allow the editor to remain for editing existing ones?

Already logged and fixed as #1008

Sorry, wrong issue...


expose FlagInfo binding methods

This exposes the Bind*Flag methods on FlagInfo to make command flag delegation easier.
@sosiouxme take a look and make sure this the exposure you want

@deads2k  +1 turning into a method makes it a little prettier to reuse FlagInfo elsewhere, thanks!

@derekwaynecarr ptal. This ought to be non-contentious.

LGTM


Basic Info

Hey, if you don't mind I got a couple of question.

Do you need a key for these calls?
Are these using the tournament API?

Thanks!

No and no :)


Parse document for tokens on every LSP on_change event

see #1177 for context.
closes #1177 and closes #1147

When/if we do re-visit manually updating small sections of a doc for optimisation purposes, we might want to do so alongside a discussion around incremental parsing in sway-core itself.

Yeah exactly, makes a lot of sense for the functionality to come from sway-core. Everything still feels pretty snappy on my end for now anyway.


How to replace?

I am sorry, for the stupid question, but how to execute command to replace?
omg, it is really beautiful plugin, but I have spent 20mins reading all docs and issues and still have no idea)))
Could you please add to the docs how to actually execute replacement? On the gif it is not clear what was pressed to replace

Just press ? in Spectre window, will show the mappings.
<leader>rc for single line replacement
<leader>R for all replacement

thank you!!!


Dockerfile.gpu needs update

face_recognition version: latest
Python version: 3.5
Operating System: arch linux

Description
While trying to build docker image with gpu support, it says --yes is no longer required for dlib.
Also one of the dependencies complaints about OpenBlas not found, using built-in blas, it says openblas will be faster.
What I Did
$ docker-compose up --build

fix
I removed all --yes for dlib buding, it works.
I think by default dlib now assumes you want to enable cuda and cudnn support.

Thanks. This is being fixed in #769.

@ageitgey Maybe add OpenBlas as well? Also, the way docker builds image is by add extra file layer for each RUN command, by making all commands in one RUN can reduce the image size from 17GB to 4GB.


Support 'options set' command and '--all-options' option in site detail

Work for this issue will begin begin on branch work-liquid-labs/cloudsite/20.


New warning appearing

I am getting this warning from pywt. It apparently has to do with me upgrading to a  most recent version of python/numpy.
/usr/lib/python3.7/site-packages/pywt/_multilevel.py:148: FutureWarning: Using a non-tuple sequence for multidimensional indexing is deprecated; use arr[tuple(seq)]instead ofarr[seq]. In the future this will be interpreted as an array index, arr[np.array(seq)], which will result either in an error or a different result.

Hi @jachymb.  This warning occurs when PyWavelets is used with Numpy 1.15.  It has been fixed by #378 and #382 the master branch. We have plans to make a new PyWavelets release including this fix soon.


Make the restore-on-build task run in its own app-domain

This addresses a recurring issue where doing a WebDeploy-based publish from within Visual Studio encounteres MissingMethodExceptions when running LibMan's Restore-on-build.  The issue is that VS Publish runs MSBuild in-proc, so it loads the build task DLL from the NuGet package, but the other LibMan assemblies are already loaded into the VS appdomain from the VSIX (often a newer version).  Any incompatibilities between these cause the build task to throw.
This fix causes the build task to be executed in its own appdomain, and as such it resolves all of its dependent assemblies from the nuget package.  The appdomain gets cleared when the build is finished, so we're not leaving duplicates of all the assmeblies loaded into VS.  Note: the Build task DLL itself is loaded into VS' primary appdomain, and will linger - this isn't a change from how it works today.
Even though AppDomainIsolatedTask is only available on net472, that's the build type that VS uses for the in-proc build, even for projects that only target netcoreapp*.

Here's an image showing how the assemblies get loaded with this change (the 2.0.78 version is a private build based on the last published NuGet package but with this fix; 2.0.95 is the latest tip from master):

This is a close representation of #523 to show that this fix works.


Add way to pass in Flutter version and channel

Currently set to only 1.0.0-stable.
Allow us to pass this in so it can be dynamic

I ended up building something for this https://github.com/MisterJimson/flutter-docker-deps


NativeStorage undefined in browser

I can't seem to get NativeStorage working in Chrome browser for testing. It works fine in the ios emulator but not in the browser. It is rather tedious to have to keep transpiling the application and re-booting the ios simulator for testing.
var ns = (typeof NativeStorage == "undefined") ? false : true;
if( ns ) {
   alert( 'Active' );
} else {
   alert( 'Inactive' );
}

Returns inactive in browser.
Chrome:
Version 61.0.3163.100 (Official Build) (64-bit)
NativeStorage installed via:
$ cordova plugin add https://github.com/TheCocoaProject/cordova-plugin-nativestorage

Out of $ cordova plugin ls:
cordova-plugin-nativestorage 2.2.2 "NativeStorage"

Working with:
$ cordova emulate ios

Doesn't work with:
$ cordova run browser

The mission-critical tests are passing... We are aware of some error functions misbehaving on the browser but not anything critical:


Using IdentityServer as external OAuth provider for .NET Framework based applications

Is it at all possible to use IdentityServer as external authentication for .NET Framework based applications? I've been trying to stich together a secure hybrid method that would allow signing into IdentityServer from an .NET Framework 461 based project, with little luck.
I wonder if anyone has attempted something similar to this and had luck with it? And if there's any existing documentation that could contain hints as to how to achieve that.

This certainly works - but
This seems to be a general question about IdentityServer - not a bug report or an issue.
Please use one of the our free or commercial support options
See here for more details.
Thanks!


FITS policy and notes

I propose we add more information on the gamma-astro-data-formats specs and FITS in the general notes section.
The main questions I think is which of our formats:

Require FITS, i.e. only FITS serialisation is supported
Shall work with FITS
Don't have to work with FITS

At the moment we have cases like EVENTS where the spec page is written in a very FITS-specific way, even though storing an event list e.g. in ECSV or HDF5 would be easy. I don't like this and would prefer to just specify the names and semantics of keys and columns, and not require the FITS serialisation format.
There's other cases like SED where we explicitly give sample files in FITS, ECSV and HDF5 format. For those, I think the main point of the "general info section on FITS" would be to explain some oddities e.g. in short and cryptic header keys, that originate from FITS limitations and traditions. E.g. we should explain that formats that support FITS should always use uppercase 8-character max header keys, because that's required for FITS (see https://github.com/open-gamma-ray-astro/gamma-astro-data-formats/pull/65#issuecomment-257879666 and following discussion)
Probably we can't get agreement on this via Github discussion.
But people can voice their use cases and preferences for the main question put above now, and then we try to settle this question at the next f2f meeting.
@woodmd @cboisson @kosack @jknodlseder

I have added a statement concerning FITS or other formats to the about / intro page:
https://github.com/open-gamma-ray-astro/gamma-astro-data-formats/pull/25/files#diff-3128ae00a14a166ce0eb757640694077R31
Closing this old issue now.


Use modern way to find Python interpreter

Use FindPython3 when it is possible. Upgrade Conan version to 1.57. Upgrade pybind11 version to 2.10.1 and support Python 3.11.

Seems to work for me. Thanks!


fix support for SSB URIs on Android Chrome

Finally found a fix for #135 . TL;DR is that on Android Chrome we have to do intent://PATH?QUERYPARAMS#Intent;scheme=ssb;end; instead of ssb://PATH?QUERYPARAMS. See Android Chrome docs. So we discover the user agent and trigger this fix only for Android Chrome.
:heavy_check_mark: Unit tests added.
:heavy_check_mark: Tested end-to-end with a phone running Manyverse (tested both Android Firefox and Android Chrome).

@cryptix @cblgh Could one of you take a look at this PR? (i.e. OR is what I'll mean when I tag you both as reviewers, not AND and not XOR :smiley_cat:)

@staltz i was intending to get to this today but alas the gods would not have it so. will give it a review next week unless @cryptix beats me to it!

Ready for a second check!

I'll merge assuming that the review was green apart from that refactor.


OperatorConfig management

Is it possible to have a better way to manage OperatorConfig? Possibly with a config map or a custom resource similar to a PodMonitoring configuration.
Manually editing the yaml as suggested by the documentation isn't ideal.
Currently I apply changes to OperatorConfig  across my environments using kubectl patch with terraform but this method isn't great either. I recently had an issue with too many metrics being scraped as I had enabled kubeletScraping for testing, after I removed the kubeletScraping config from my local yaml file I apply with kubectl patch it did not remove the config itself from kubernetes.

yeah, can't manage it with TF (without hacks to patch), can't use helm (does not want to modify resources it does not own).
I'm trying (also hackish) solution to use kubernetes_labels/annotation TF resources to make helm "own" it and then use helm chart to manage it, but it is also not great...

Hi @shpml and @bjakubski,

I recently had an issue with too many metrics being scraped as I had enabled kubeletScraping for testing, after I removed the kubeletScraping config from my local yaml file I apply with kubectl patch it did not remove the config itself from kubernetes.

Are you trying to remove the entire OperatorConfig using patch? I'm not sure I follow.
With regards to managing the OperatorConfig, you should be able to update it and source-control it the same way as you would a PodMonitoring, no? It's just another custom resource watched by the operator. The main difference is that it's a singleton in a fixed namespace in the cluster. So, in theory, there should be less of them to manage than PodMonitorings.
But maybe I'm misunderstanding your question 🙂

Hi @pintohutch
I patch the OperatorConfig to limit the metrics I want to send to Cloud Monitoring. I do this using kubectl patch operatorconfig/config --namespace gmp-public --type merge --patch-file ${path.module}/templates/operator_config_patch.yaml. This command is run by terraform using local-exec.
collection:
  filter:
    matchOneOf:
      - '{__name__=~"puma_.+"}'
      - '{__name__=~"action_cable_.+"}'
      - '{__name__=~"sidekiq_.+"}'
      - '{__name__=~"k8s_app:.+"}'

I can't really manage this in terraform any other way as the resource is created automatically when managed prometheus is enabled on the cluster. Managed prometheus is enabled with the command gcloud container clusters update --enable-managed-prometheus for now but I will migrate to using the terraform config now that this issue is closed but it doesn't fix my problem.
If I try manage the OperatorConfig with terraform using the below kubernetes_manifest I get an error as the OperatorConfigresource is already created. I assume managed prometheus only works with an OperatorConfig named "config". If not I can just deploy an OperatorConfig  with a different name.
resource "kubernetes_manifest" "operatorconfig_gmp_public_config" {
  manifest = {
    "apiVersion" = "monitoring.googleapis.com/v1"
    "collection" = {
      "filter" = {
        "matchOneOf" = [
          "{__name__=~\"puma_.+\"}",
          "{__name__=~\"action_cable_.+\"}",
          "{__name__=~\"sidekiq_.+\"}",
          "{__name__=~\"k8s_app:.+\"}",
        ]
      }
    }
    "kind" = "OperatorConfig"
    "metadata" = {
      "labels" = {
        "addonmanager.kubernetes.io/mode" = "Reconcile"
        "deployed-by"                     = "terraform"
      }
      "name"      = "config"
      "namespace" = "gmp-public"
    }
  }
}

With the PodMonitoring config I can deploy as many configurations as I like using the below kubernetes_manifest in terraform as an example.
resource "kubernetes_manifest" "prom_app_scaping" {
  manifest = {
    apiVersion = "monitoring.googleapis.com/v1alpha1"
    kind       = "PodMonitoring"
    metadata = {
      name      = "${var.common_labels.env}-prom-scaper"
      namespace = "default"
      labels = {
        "app.kubernetes.io/name" = "${var.common_labels.env}-prom-scaper"
      }

    }
    spec = {
      endpoints = [
        {
          interval = var.scrape_interval
          path     = "/metrics"
          port     = 3000
          scheme   = "http"
        }
      ]
      selector = {
        matchLabels = {
          prometheus-scrape = "true"
        }
      }
    }
  }
}

I hope this makes sense. I could wait for the OperatorConfig to be created and then import it into terraform but that workaround is also not ideal and doesn't scale well across multiple projects.

Hi @pintohutch
I patch the OperatorConfig to limit the metrics I want to send to Cloud Monitoring. I do this using kubectl patch operatorconfig/config --namespace gmp-public --type merge --patch-file ${path.module}/templates/operator_config_patch.yaml. This command is run by terraform using local-exec.
collection:
  filter:
    matchOneOf:
      - '{__name__=~"puma_.+"}'
      - '{__name__=~"action_cable_.+"}'
      - '{__name__=~"sidekiq_.+"}'
      - '{__name__=~"k8s_app:.+"}'

I can't really manage this in terraform any other way as the resource is created automatically when managed prometheus is enabled on the cluster. Managed prometheus is enabled with the command gcloud container clusters update --enable-managed-prometheus for now but I will migrate to using the terraform config now that this issue is closed but it doesn't fix my problem.
If I try manage the OperatorConfig with terraform using the below kubernetes_manifest I get an error as the OperatorConfigresource is already created. I assume managed prometheus only works with an OperatorConfig named "config". If not I can just deploy an OperatorConfig  with a different name.
resource "kubernetes_manifest" "operatorconfig_gmp_public_config" {
  manifest = {
    "apiVersion" = "monitoring.googleapis.com/v1"
    "collection" = {
      "filter" = {
        "matchOneOf" = [
          "{__name__=~\"puma_.+\"}",
          "{__name__=~\"action_cable_.+\"}",
          "{__name__=~\"sidekiq_.+\"}",
          "{__name__=~\"k8s_app:.+\"}",
        ]
      }
    }
    "kind" = "OperatorConfig"
    "metadata" = {
      "labels" = {
        "addonmanager.kubernetes.io/mode" = "Reconcile"
        "deployed-by"                     = "terraform"
      }
      "name"      = "config"
      "namespace" = "gmp-public"
    }
  }
}

With the PodMonitoring config I can deploy as many configurations as I like using the below kubernetes_manifest in terraform as an example.
resource "kubernetes_manifest" "prom_app_scaping" {
  manifest = {
    apiVersion = "monitoring.googleapis.com/v1alpha1"
    kind       = "PodMonitoring"
    metadata = {
      name      = "${var.common_labels.env}-prom-scaper"
      namespace = "default"
      labels = {
        "app.kubernetes.io/name" = "${var.common_labels.env}-prom-scaper"
      }

    }
    spec = {
      endpoints = [
        {
          interval = var.scrape_interval
          path     = "/metrics"
          port     = 3000
          scheme   = "http"
        }
      ]
      selector = {
        matchLabels = {
          prometheus-scrape = "true"
        }
      }
    }
  }
}

I hope this makes sense. I could wait for the OperatorConfig to be created and then import it into terraform but that workaround is also not ideal and doesn't scale well across multiple projects.

Hi @pintohutch
@shpml described the issue nicely.
I'll only add that it is not easily possible to manage OperatorConfig with helm too due to the same issue - this object is created by GKE/operator it is "foreign" to helm and it will refuse to update it.

Hi @shpml and @bjakubski,
Apologies for the delayed response. I'm just returning back from leave over the holidays.
Thanks for making this use-case more clear and I think I see the issue.
I do see an open issue for the Kubernetes Terraform provider to support kubectl patch that has quite a lot of activity. It's unclear if the patch functionality would be supported for all resource types or not though (i.e. custom resources).

I assume managed prometheus only works with an OperatorConfig named "config". If not I can just deploy an OperatorConfig with a different name.

Yes that is correct. The "config" OperatorConfig is created by the GKE control plane as a singleton resource in the cluster and is referred by name in-source.
The workarounds you've mentioned are probably the best options for now. The only other solution would be to deploy managed collection yourself through the install manifests (i.e. not through the GKE API) using the kubernetes_mainfest for those.
There may be a path forward in a future release, but we'd need to evaluate. Do you have a proposal for how you think this would look like using a ConfigMap?
Either way, we can keep this issue open for consideration.

A proposal for how it would work with a ConfigMap would be for the operator to look for a ConfigMap named config or something more specific like gmp-opertor-config, or via a predefined label on a ConfigMap, app.kubernetes.io/gmp-opertor-config=True. The user can add configuration options here that the operator can merge into it's OperatorConfig
apiVersion: v1
kind: ConfigMap
metadata:
  name: gmp-opertor-config
  namespace: gmp-public
data:
  config.yaml: |
    collection:
      filter:
        matchOneOf:
        - '{__name__=~"puma_.+"}'
        - '{__name__=~"action_cable_.+"}'
        - '{__name__=~"sidekiq_.+"}'
        - '{__name__=~"k8s_app:.+"}'

Alternatively use operatorconfigs that a user could deploy to configure the operator. The operator can merge these together to use for it's configuration.
apiVersion: monitoring.googleapis.com/v1
kind: OperatorConfig
metadata:
  name: gmp-opertor-config
  namespace: gmp-public
collection:
  filter:
    matchOneOf:
    - '{__name__=~"puma_.+"}'
    - '{__name__=~"action_cable_.+"}'
    - '{__name__=~"sidekiq_.+"}'
    - '{__name__=~"k8s_app:.+"}'

Gotcha - thanks for the suggestions! We'll consider this and maybe some other options to better support this use case.
Btw, in the meantime, I wonder if using GKE ConfigSync could be an approach to keeping your OperatorConfigs in sync across clusters.
We haven't experimented much with it, but may be worth trying.

Hi @pintohutch
I patch the OperatorConfig to limit the metrics I want to send to Cloud Monitoring. I do this using kubectl patch operatorconfig/config --namespace gmp-public --type merge --patch-file ${path.module}/templates/operator_config_patch.yaml. This command is run by terraform using local-exec.
collection:
  filter:
    matchOneOf:
      - '{__name__=~"puma_.+"}'
      - '{__name__=~"action_cable_.+"}'
      - '{__name__=~"sidekiq_.+"}'
      - '{__name__=~"k8s_app:.+"}'

I can't really manage this in terraform any other way as the resource is created automatically when managed prometheus is enabled on the cluster. Managed prometheus is enabled with the command gcloud container clusters update --enable-managed-prometheus for now but I will migrate to using the terraform config now that this issue is closed but it doesn't fix my problem.
If I try manage the OperatorConfig with terraform using the below kubernetes_manifest I get an error as the OperatorConfigresource is already created. I assume managed prometheus only works with an OperatorConfig named "config". If not I can just deploy an OperatorConfig with a different name.
resource "kubernetes_manifest" "operatorconfig_gmp_public_config" {
  manifest = {
    "apiVersion" = "monitoring.googleapis.com/v1"
    "collection" = {
      "filter" = {
        "matchOneOf" = [
          "{__name__=~\"puma_.+\"}",
          "{__name__=~\"action_cable_.+\"}",
          "{__name__=~\"sidekiq_.+\"}",
          "{__name__=~\"k8s_app:.+\"}",
        ]
      }
    }
    "kind" = "OperatorConfig"
    "metadata" = {
      "labels" = {
        "addonmanager.kubernetes.io/mode" = "Reconcile"
        "deployed-by"                     = "terraform"
      }
      "name"      = "config"
      "namespace" = "gmp-public"
    }
  }
}

With the PodMonitoring config I can deploy as many configurations as I like using the below kubernetes_manifest in terraform as an example.
resource "kubernetes_manifest" "prom_app_scaping" {
  manifest = {
    apiVersion = "monitoring.googleapis.com/v1alpha1"
    kind       = "PodMonitoring"
    metadata = {
      name      = "${var.common_labels.env}-prom-scaper"
      namespace = "default"
      labels = {
        "app.kubernetes.io/name" = "${var.common_labels.env}-prom-scaper"
      }

    }
    spec = {
      endpoints = [
        {
          interval = var.scrape_interval
          path     = "/metrics"
          port     = 3000
          scheme   = "http"
        }
      ]
      selector = {
        matchLabels = {
          prometheus-scrape = "true"
        }
      }
    }
  }
}

I hope this makes sense. I could wait for the OperatorConfig to be created and then import it into terraform but that workaround is also not ideal and doesn't scale well across multiple projects.

@shpml would you be able to share the example of managing operatorconfig with terraform?

@shpml would you be able to share the example of managing operatorconfig with terraform?

# filename="operator_config_patch.yaml"
collection:
  filter:
    matchOneOf:
      - '{__name__=~"puma_.+"}'
      - '{__name__=~"action_cable_.+"}'
      - '{__name__=~"sidekiq_.+"}'
      - '{__name__=~"k8s_app:.+"}'

Terraform null resource.
# Patch the operator config deployed by GCP tp specify metrics to collect.
# We patch instead of managing the respurce as it's deployed by GCP and likely to be updated.
# A patch only adds, it does not remove
resource "null_resource" "patch_operator_config" {
  triggers = {
    yaml_update = "${filesha512("${path.module}/templates/operator_config_patch.yaml")}"
    # To force null_resource recreation uncomment below
    # always_run = timestamp()
  }
  provisioner "local-exec" {
    command = <<EOF
# Authenticate to cluster
gcloud container clusters get-credentials $CLUSTER_NAME --region $REGION --project $PROJECT

# Patch operatorconfig/config
kubectl patch operatorconfig/config --namespace gmp-public --type merge --patch-file ${path.module}/templates/operator_config_patch.yaml
EOF
    environment = {
      # used to by gcloud to auth with correct cluster
      CLUSTER_NAME = var.cluster_name
      PROJECT = var.project_id
      REGION  = var.region
    }
  }
}

Have you faced any side effects or issues with this? One of the thing I am noticing is if I remove the entire patch config it does not remove it(this is just I am trying locally). Have you thought about deleting entirely the operator config and managing it?


compatibility with MariaDB 10.2  and PHP 7.1

Possible to have a  fix  for Quake3-vsp-stats with MariaDB  and PHP 7.1 ?
thx!

Hello,
As vsp-stats is pretty old, it used a very old version of adodb (3.50 19 May 2003)
I just updated the adodb lib to 5.20.10 (latest) and changed the corresponding config to make use of the now needed mysqli driver.
I don't have any game.log for testing right now - at least i was able to call it from the browser and it did not throw any PHP error...
Could you please give it a try and tell me if it works?
50a82222b150b92f5f6bbb625b9b2bdc6847ffa7
Cheers,
Martin

Hello thanks you for the update,
I did the test,  I'm now able to call it from the browser  but noting are showed, http://<IP_ADDRESS>/vsp/pub/themes/bismarck/index.php?config=cfg-default.php.
When I go see my database ffa_vsp  with phpmyadmin   ther enoting have been created in ...  So yeah, I think the Stats dosen't read the game.log
Best regards,
jf.

Hm.. did you run the games.log import as described under point 3.c in the readme?

Yes I did  via Power Shell http://prntscr.com/im9nv0   and via  the web  http://prntscr.com/im9par http://prntscr.com/im9pgy
1- There noting get created into my  database  ffa_vsp
2- You can see my database setting  in  cfg-default.php -   http://prntscr.com/im9swx
3- Here the game settings set to 'q3a'   - http://prntscr.com/im9ujh
I dont know why noting get create in the database,   maybe need to enable a option in the php.ini for adodb?

Good job this working 👍   http://<IP_ADDRESS>/vsp-stats/pub/themes/bismarck/index.php
Small question: how  to show the adwards list    ?

Hm.. this worked for me.
Did you use the master branch?
I have the feeling it might relate to this change: https://github.com/evilru/quake3-vsp-stats/commit/692b27261afe2437ee986c30d0250152b6def0bc

This was a mistake in my setting..  This working just fine now except for the flags...   Probally a other setting not set correctly .


Phi-3 medium generation issue

I am using LoneStriker/Phi-3-medium-4k-instruct-8.0bpw-h8-exl2 but the generation is gibberish.
https://huggingface.co/LoneStriker/Phi-3-medium-4k-instruct-8.0bpw-h8-exl2
When I tried the same prompt on the unquantized version of the model, it works fine.
I am using exllamav2 - 0.1.1
latest transformers and torch and flash-attn.
prompt = '''<|user|>
Your goal is to generate hints and descriptions from documents given feedback. You'll be given:

-A document: The text you need to analyze.
-Target Field/Key: The field that corresponds to the Feedback Value in the document. You have to extract value for this field for investor.
-Correct Feedback Value: The answer you're trying to extract, related to the Target Field. The specific value you need extarct using hints, questions, and descriptions. If the feedback value is "Not Found", the model should explain why the valuefor the 'Partnership Expenses' is not present in the document.
-Incorrect Field: A field you should IGNORE; it's NOT the target.

Your Tasks:

-Create Hints: Write three hints that describes the definition of 'Partnership Expenses' in terms of capital call/fund space document type. Never add the actual field/fund names in hints. Add one hint from three that instructs model to avoid extracting Incorrect Field.
-Create Context Descriptions: Write three descriptions of why the value for the 'Partnership Expenses' is 'Not Found' for the Investor. Descriptions should use the document text to identify the correct field for the value and then provide the definition to the field. Never add the actual fund names in hints.

Document below:
PINNACLE  FUND  SERVICES
                                                                                1095 West Pender Street, Suite 1130
                    P|   N   N   NCLE                                                          Vancouver, BC V6E 2M6 CANADA
                                                                                Tel +1<PHONE_NUMBER>
                                                                                Fax +1604.628.2178
                                                    Demo   VC   Fund  I LP
                                                   Capital  Call  Request
     August 5,                                                                                Investor ID:
     Test Investor 1
     555 Any Street
     Toronto, ON M4V
     4V4 Canada
     Dear Investor,
     General Partner Inc., the General Partner of Demo  VC   Fund  |, LP (the "Partnership") hereby  advises you  that, in
     accordance with  the terms  of  the Limited  Partnership Agreement,   a Capital Call is currently required  from  the
     Limited Partners.    We   are  hereby  providing you  with  this Capital  Call Notice regarding  Test  Investor   1's
     commitment   to the Partnership, which is due no later than Wednesday, July 13, 2016.
     In accordance with the  Partnership Agreement,  a capital contribution is being drawn  down  from  investors and will
     be applied by the Partnership in the manner set out on the following page.
     Your share of the amount due is CAD $0.
     This amount  is due and  payable  by 5:00pm   Easter Standard Time  on July 13, 2016.  Please ensure  that you check
     with your bank for the cost of the wire transfer.
     Wire transfer instructions are as follows:
          Beneficiary Bank:                     CIBC Private Banking
          Beneficiary Address:                  125  Main Street, Hamilton ON, M5M 5M5
          Beneficiary Bank Number:              010
          Beneficiary Transit Number:           00009
          Beneficiary Account Number:          54-66717
          SWIFT:                                CIBCCATT
          Beneficiary Customer:                 Demo  VC  Fund LP
          Beneficiary Address:                  101  Bay Street, Suite
                                                2340  Toronto ON, M4A
                                                1A3
          Reference:                            Capital Call - Investor 13665
     If you have any questions, please contact David Smith by phone at +1<PHONE_NUMBER> or by email at
<EMAIL_ADDRESS>     Sincerely,
     Pinnacle Fund Services
      www   .pinnaclefundservices.comVp,

NEXT PAGE

                                                                             PINNACLE FUND SERVICES
                                                                             1095 West Pender Street, Suite 1130
     (4         PINN      NCLE                                               Vancouver, BC V6E 2M6 CANADA
                                                                             Tel +1<PHONE_NUMBER>
                                                                             Fax +1<PHONE_NUMBER>
                                          Demo  VC Fund  I LP
                                         Capital Call Request
    August 5,                                                                         Investor ID:
    Test Investor 1
    555 Any Street
    Toronto, ON M4V
    4V4 Canada
      Below is a summary of your capital activity to date:
                    a                   Aggregate   Fund      Your  Pro-Rata
              Description                 Commitment               Share
    otal Committed   Capital         $15,000,000.00          $3,000,000.00
   Capital Call Details
   Capital call required for Fund V  $ 100,000.00            $ 20,000.00
   Q2 2024 Management   Fees         45,000.00               9,000.00
   stated    Fund Expenses for Q2    15.000.00               3.000.00
   Placement Agent Fees              18,750.00               3,750.00
   Adjustments  &  Returns
   Return of Capital - Management    (7,500.00)              (1,500.00)
   Proceeds from Recent Exit         11,250.00               2,250.00
   Working Capital Deficit           7,500.00                1,500.00
   General Partner Contribution      3,750.00                750.00
   Realized Gain on Cash Investment  4,500.00                900.00
   Realized Loss on Equity Sale      (3,000.00)              (600.00)
   Clawback Obligation               3,750.00                750.00
   Dividend Income                   2,250.00                450.00
   Return of Invested Capital        6,000.00                1,200.00
   Return of Invested Stock Capital  5,250.00                1,050.00
   Management  Fee Rebate            3,000.00                600.00
   Refund of Fund Expenses           2,250.00                450.00
   Overcalled Capital Refund         3,000.00                600.00
   Tax Liability                     1,500.00                300.00
   Return of Fund Expenses (Interim) (4,500.00)              (900.00)
   Recallable Amount                 750.00                  150.00
    otal Amount  Applied  to Capital
                                      285,750.00               57,150.00
                    |          Cs                            ®
   Less: Amount Applied from Existing (27,150.00)
   Deposit
    otal Cash Proceeds   Due         $285,750.00             $30,000.00

NEXT PAGE

                                                                                PINNACLE  FUND  SERVICES
                                                                                1095 West Pender Street, Suite 1130
                  P|   N   N   NCLE                                                      Vancouver, BC V6E 2M6 CANADA
                                                                                Tel +1<PHONE_NUMBER>
                                                                                Fax +1604.628.2178
                                                Demo   VC   Fund  I LP
                                                Capital Call  Request
    August 5,                                                                                Investor ID:
    Test Investor 1
    555 Any Street
    Toronto, ON M4V
    4V4 Canada
       Below is a summary of your deposit activity to date:
                                                               A
                        Description                           Amount
                                P                              (CAD)
      Cumulative deposits received, before this capital call $2,000,000.00
      Total amount applied to deposit balance, before this   ($1,850,000.0
      call                                                   0)
      Total amount applied to deposit balance, this capital  ($38,100.00)
      Deposit balance remaining, after this capital call     $111,900.00
        The deposit balance above being held by the Partnership is non-interest bearing and will be applied to future capital
        calls.
     www   .pinnaclefundservices.comVp,

END DOCUMENT.

Target Key/Field: Partnership Expenses

Correct Feedback Value: Not Found

Incorrect Field: Realized Loss on Equity Sale

The value for the key/field "Partnership Expenses" should be "Not Found".

JSON: {"hints":[],"descriptions":[]}

Remember:

-Three hints. Never add the actual field/fund names in hints.
-Three descriptions of why the value for the 'Partnership Expenses' is 'Not Found' for the Investor (without stating theirvalues).
-These should guide the model to locate the "Partnership Expenses" and extract the correct feedback value from the document.

COMPLETE AND RESPOND ONLY THE JSON AND PROVIDE NO EXPLANATION. <|end|>
<|assistant|>
'''
input_ids = tokenizer.encode(prompt)
sys.stdout.flush()
settings = ExLlamaV2Sampler.Settings()
settings.temperature = 0.9
settings.top_k = 5
settings.top_p = 0.9
settings.token_repetition_penalty = 1.15
max_new_tokens = 30
generator.set_stop_conditions([128009,tokenizer.eos_token_id,"eot"])
generator.begin_stream_ex(input_ids, settings)

generated_tokens = 0
ans = ''
while True:
    res = generator.stream_ex()
    chunk = res["chunk"]
    eos = res["eos"]
    generated_tokens += 1
    sys.stdout.flush()
    if eos or generated_tokens == max_new_tokens: break
    ans += chunk
    #yield chunk
    print(chunk,end='')

EXLLAMAV2 OUTPUT:
Feedback ValuesExpense.

Solution=Value Extract the solution<|end|><|assistant|> Around themself.
EXPECTORIGNOUNITSometimes they must find exactly whatnot found.<|end|><|assistant|> SolutionExtracted values.

Output the output Format: [{"output. They are asked to OutputFormatAnswer.<|end|><|assistant|> Findingsolutionself.

IMPORTEDUCtogether.

TaskInstructions.

It

UNQUANTIZED TRANSFORMERS OUTPUT:

{

 "hints": [

   "Look for sections detailing financial transactions related to the partnership's operations.",

   "Identify any line items that may represent expenses incurred by the partnership.",

   "Search for terms that typically indicate expenses, such as 'fees', 'costs', or 'expenses'."

 ],

 "descriptions": [

   "The document does not contain a specific line item or section labeled as 'Partnership Expenses'.",

   "While the document lists various financial activities, none are explicitly categorized under 'Partnership Expenses'.",

   "The document details capital calls, management fees, and other investment-related transactions, but does not itemize expenses under the heading 'Partnership Expenses'."

 ]

}

There's something strange going on with that model. I don't know if it's converted wrong somehow or if there's something in the architecture that differs between mini-4k (which works) and medium-4k.
I tested it with medium-128k, though, and I got this:
{
  "hints": [
    "Look for costs associated directly to partnership operations.",
    "Search within sections detailing operational expenses.",
    "Ignore entries about equity loss."
  ],
  "context_descriptions": [
    "Despite detailed breakdowns of various financial aspects such as management fees, placement agent fees etc., there was no explicit mention of 'Partnership Expenses'. These typically include overhead like office rentals, utilities etc. However none were listed under these categories indicating they might not exist.",
    "'Realized Loss on Equity Sale', while an important entry, does not fall into the category of 'Partnership Expenses'; hence its absence explains why we cannot find the desired data.",
    "While other line items indicate monetary transactions linked to the operation of the venture, 'Partnership Expenses' specifically refers to recurring operating costs, none of which seem to be indicated thus leading us towards our conclusion."
  ]
}

So maybe that's an option until I can get around to figuring out what's up with the 4k version? You can always set config.max_seq_len = 4096 to limit VRAM usage if necessary.

Thanks

I tried with multiple exl quants for phi-medium-4k and they all fail. I don't think all exl quants could go wrong. Any suggestions @turboderp

I had some problem with Phi-3-medium-128k where it spit out repetitive answer with almost unlimited length, even for a very simple question. Have tried the 8bit ant 6.5 one but it did not help.
Is it possible that the problem is related to this one too?
I tried the unquantized one on Azure and nothings wrong...


fix: site disabled audit type

When the given audit type was disabled for the given site, the API was returning: Triggered broken-backlinks audit for undefined and no audit was actually triggered.
Please ensure your pull request adheres to the following guidelines:

[ ] make sure to link the related issues in this description
[ ] when merging / squashing, make sure the fixed issue references are visible in the commits, for easy compilation of release notes

Related Issues
Thanks for contributing!

:tada: This PR is included in version 1.16.2 :tada:
The release is available on:

v1.16.2
GitHub release

Your semantic-release bot :package::rocket:


Add .dataFilter function prior to parsing of body

This function allows you to transform the data prior to parsing of the body. It attempts not to be opinionated on the type of data or what you are trying to do to it. The basic application:
request
  .get('url.com/foo')
  .dataFilter((data) => {
    return data.replace(/text_to_strip/g, '');
  })
  .end((err, res) => {
    console.log(res.body); // will have text_to_strip removed globally from the data
  });

The original application I was striving for was stripping of XSS prefixes / postfixes, however I tried to make it more generalized so that it could be used for a multitude of purposes. This method is only applied in the parseBody function, and if nothing is returned from the callback passed then it falls back to the original str value passed to parseBody.
Apologies in advance for the lack of commit squashing.

Apologies again, I have no easy way to produce a test for this locally as I don't have saucelabs credentials and therefore cannot do the BROWSER=1 test. Based on another client test, I modified to see if this would work. I promise I have tested it in the real world ...

You can run tests without saucelabs with make test-browser-local

@pornel Thanks, that is some badassery. I ran that locally and all my tests passed, and I know my travis build failed but I don't think it was due to my test.

Yeah, travis tests are sometimes a bit flaky and need restarting.

Ah sweet, noticed the browser test was kicked off again and passed, I assume that was you. :)

I would prefer not to add more API surface for this. Is this not reasonably achievable already with request.parse['application/json'] = stripPrefixes?
In either case this would need consistency in the node/client code before merging.

Going about it in the way you recommended appears to solve my issue. Thanks!


volumerize multi backup creates not defined volume

Hi support team,
I'm an absolute beginner in the docker world, but I faced a behavior which I do not understand.
Maybe you can support here:
My goal is to backup each volume in a different mount directory. I have currently two volumes, one for bitwarden and one for portainer data.
I'm running following command:
docker run -d
--name volumerize
-v /var/run/docker.sock:/var/run/docker.sock
-v bitwarden_data:/source/bitwarden_data:ro
-v portainer_data:/source/portainer_data:ro
-v /volume2/docker/volumerize/bitwarden_data:/backup/bitwarden_data
-v /volume2/docker/volumerize/portainer_data:/backup/portainer_data
-v volumerize_cache_bitwarden:/volumerize-cache/bitwarden
-v volumerize_cache_portainer:/volumerize-cache/portainer
-e "VOLUMERIZE_CONTAINERS=bitwarden portainer"
-e "TZ=Europe/Berlin"
-e "VOLUMERIZE_JOBBER_TIME=0 0 3 * * *"
-e "VOLUMERIZE_SOURCE1=/source/bitwarden_data"
-e "VOLUMERIZE_TARGET1=file:///backup/bitwarden_data"
-e "VOLUMERIZE_CACHE1=/volumerize-cache/bitwarden"
-e "VOLUMERIZE_SOURCE2=/source/portainer_data"
-e "VOLUMERIZE_TARGET2=file:///backup/portainer_data"
-e "VOLUMERIZE_CACHE2=/volumerize-cache/portainer"
blacklabelops/volumerize
after running the stuff and triggering a manual backup, it looks good.
I see some files in each mount directory and also some data in each volumerize_cache volume.
But it seems that in addition a additional volume was created with a cryptic ID: 0f6567cc6d2925475fb6e2df8bd726da7e2c8bf00fa11048ca71a5b808063f5f,
containing two empty folders with name "bitwarden" and "portainer".
This is what I didn't get.
Second question:
When running two instances of volumerize, for each volume a dedicated instance, can I share the volumerize_cache volume?
Do you have a template code for running two instances?
Sorry for those newbie questions, but sometimes it work's and sometime you learn. Today I learn ;-)
And the most important stuff: Thanks for this great software!!!
All the Best,
Lina

I strongly advice to NOT share a duplicity cache! Duplicity cannot handle this. Each duplicity backup routine must have its own cache.

Hi blacklabelops,
thanks for your feedback.

I do not know where the cryptic (docker-)volume comes from.

Does that mean, that my docker -run statement seems to be ok?
I'm not sure regarding the subfolders for /source, /backup and /cache. e.g:
-v volumerize_cache_bitwarden:/volumerize-cache/bitwarden
-v volumerize_cache_portainer:/volumerize-cache/portainer
is it ok to create subfolders in/source, /backup and /volumerize-cache?
second point I'm not sure about the XXX1 and XXX2 paths.
-e "VOLUMERIZE_SOURCE1=/source/bitwarden_data"
-e "VOLUMERIZE_TARGET1=file:///backup/bitwarden_data"
-e "VOLUMERIZE_CACHE1=/volumerize-cache/bitwarden"
for my understanding VOLUMERIZE_SOURCE1 is a fix parameter/name and the mapping is the same like for my volume.
Same for VOLUMERIZE_TARGET1 and VOLUMERIZE_CACHE1, right?
Would be great to get some confirmation if my statements are looking good or not.
Thanks so much and Best Regards!


Change channel levels

Would it be possible to read and change the channel level?
I have a Marantz SR6010 and would love to be able to remote change the subwoofer level.
I know I can do a post to /OPTION/CHANNELLEVELADJUST/s_option.asp
Would be cool If I could then automate this through home assistant. (If our child is to sleep lower the subwoofer level automaticly)
Would you be interested in a PR for this?

check out this PR: https://github.com/scarface-4711/denonavr/pull/144
I think someone is already working on this.
However I do not know what the current state on that PR is...

the PR #144 is ready for review. Feel free to give it a try with your model :smile:

I don't think that is what I mean. #144 is about treble and base. I am talking about the channels. (front left, front right, rear, subwoofer level)
This is how it look through the web interface of the marantz

These sorts of commands looked like this on my Denon 1400.
Confirmed that -12dB = 0, 0dB = 24, +12dB = 48
Confirmed uses conventional names:
FL, FR, SL, SR, SW, C (probably RL and RR for 7.1)
Someone would need to check Atmos naming conventions
but manually setting Atmos channels isn't really desirable.
<?xml version="1.0" encoding="utf-8"?>
<tx>
  <cmd id="1">SetChLevel</cmd>
  <name>SR</name>
  <value>24</value>
</tx>

From my data dump here https://github.com/JPHutchins/denonavr/blob/d9797c6e629b963db3a0f760d16ade3e635070b2/doc/XML_data_dump.txt#L186-L196
And can be implemented like:
https://github.com/JPHutchins/denonavr/blob/master/denonavr/helpers.py
And:
https://github.com/JPHutchins/denonavr/blob/master/denonavr/commands.py
For example this will set LFE channel level
SET_LFE_LEVEL = XmlCommand1(
    "Subwoofer Level", "SetChLevel", (0, 48)
)

And can be called from the main program like:
def set_lfe_level(self, value):
    """Set LFE Level via HTTP post command."""
    try:
        response = self.exec_xml_appcommand_post(SET_LFE_LEVEL, value)
    except requests.exceptions.RequestException:
        _LOGGER.error("Connection error: command not sent.")
        return response

It was going to be a ton of work to redo the entire command library using these XML formats so I abandoned it.  It is my hope to discover a means of "getting valid command lists" over SSDP to overcome generational differences in command formats.  It is noteworthy that Denon, and many brands, do often maintain backwards compatibility of IP commands even if it is not documented.

Have you tried the denonavr.get_command service?  https://www.home-assistant.io/integrations/denonavr/#service-denonavrget_command?
I see that we are exposing denonavr.send_get_command() to the HA integration.  So accommodating more POST commands should be as simple as exposing denonavr.send_post_command() to HA.
First step would be to verify perhaps via Python repl that your command works as follows:
pip install denonavr
import denonavr
d = denonavr.DenonAVR("IP address as string")
d.send_post_command("/OPTION/CHANNELLEVELADJUST/s_option.asp", "I don't know what the body should be - try numbers between 0 and 48?")

https://github.com/scarface-4711/denonavr/blob/fa670e5daf8a7859b2b1eaff6f707d5100e7d2f8/denonavr/denonavr.py#L413-L424


add settings example

The common extension points don't list settings. I think it is an important example to add.

Sounds good :+1:
The example could limit itself to simply add a flag in the settings.


Make MDX a code language

Changes proposed:

[x] Add
[x] Delete

Adds MDX as a language designation. MDX's website recommends a community-created extension called MDX for syntax highlighting in VS Code, and this extension adds the language ID mdx.
The reason that just the file extension .mdx isn't quite enough is because Next.js's MDX plugin allows MDX parsing of .md files. I ran into this problem in the process of writing a documentation PR for styled-components, whose website uses this pattern. To correct the syntax highlighting, I added the following file association to my VSCodium settings:
"files.associations": {
  "**/pages/**/*.md": "mdx"
},

While this did fix the highlighting, it broke my file icons on those pages:

This change should fix that.

Related to #1766, which had not referenced a extension with a supported language id for this.


Deprecate cron_expression

Tracking issue
Bringing https://github.com/flyteorg/flyte/issues/529 from the afterlife so that we can close it for real this time.
Why are the changes needed?
cron_expression has been deprecated for a number of years. This PR just finalizes the job in the sdk to prevent anyone from using it.

What changes were proposed in this pull request?

How was this patch tested?

Setup process
Screenshots
Check all the applicable boxes

[ ] I updated the documentation accordingly.
[ ] All new and existing tests passed.
[ ] All commits are signed-off.

Related PRs

Docs link

The dbt failures are unrelated. I'm going to fix them in a separate PR.


linux cent os 8 dependencies was not found

An assembly specified in the application dependencies manifest xxx was not found:
package: 'ExcelDataReader.DataSet', version: '3.6.0'
path: 'lib/netstandard2.0/ExcelDataReader.DataSet.dll'

Hi!
First of all, I don't think this is a problem with ExcelDataReader, but rather a more general problem related to the .NET Core tooling and the use thereof. The error message has lots of hits in search engines, but no single solution and plenty frustrated developers :(
Are you able to use other libraries as dependencies or does it only happen with ExcelDataReader?
Some ideas;

publish your app as being self contained  (dotnet publish ... --self-contained true)
make sure you specify a runtime specifier (dotnet publish ... -r linux-x64)
delete all build outputs (i.e bin and obj directories) to force a full rebuild of your project
make sure all projects making up your app reference the same version of ExcelDataReader
create a minimal repro in a github repository and link it here so we can try and reproduce


?

Bypass leaf signature
install git
Otherwise cliflix does not works.

What are you talking about?

Tell people that you need bypass leaf_signature and install git.
Otherwise you can not install your cliflix. git is necessary.
Am I right ?

You don't need git installed. And what's bypass leaf_signature supposed to be?

I am running node.js in windows, so I need install git.

Weird. 🤔

[Error: UNABLE_TO_VERIFY_LEAF_SIGNATURE]

This is probably not an error caused by cliflix directly.

P.S.: certo che parlare tra due catanesi in inglese .... ci voli facci.

😄

[Error: UNABLE_TO_VERIFY_LEAF_SIGNATURE]
You are right. This is not an error caused by cliflix.
But I do not want install git. So, bye bye cliflix ?
Studying about.
Wishes.


Add table azure_security_center_setting

References
2.9 Ensure that Windows Defender ATP (WDATP) integration with Security Center is selected (Manual)
2.10 Ensure that Microsoft Cloud App Security (MCAS) integration with Security Center is selected (Manual)

api does not provide the properties or status field.


Does apheleia preserve mark as well as point?

It seems like it doesn't, which is occasionally disruptive. If it doesn't, I'd be happy to look into contributing this functionality?

I had a look through, and yep, you're right - I don't think this was ever implemented. I think it should not be too hard to preserve mark, or indeed all marks in the buffer. Whoops!

Opened #198 !


Multiple release sources

#5
This solution works by creating a virtual project which is injected as a dependency for all of the sources specified by the user. Release planning is then run starting from this root node.
The solution is suboptimal in the following ways:

it ignores the ReleaseState.sources groundwork
projects are always bumped one minor version forwards i.e 0.4.3 -> 0.5.0.

I merged this branch by accident and will create a second pull request with the new changes 🤷


How do I connect with third-party libraries such as ib_insync

Hello,
First thanks a lot for ibeam!
I am running the ibeam docker image on my mac and I can successfully interact with the IB API via Insomnia, pulling market data and placing orders.
I wondered is it possible to connect via libraries such as ib_insync? (https://github.com/erdewit/ib_insync). When I try, I get timeout error.
Maybe this is because of missing SSL certificate? I am not currently using an SSL certificate as described in the ibeam documentation. In Insomina I disabled certificate validation. But even if I created my own certificate, would this likely help me to connect here, given I cannot pass the location of the certificate when connecting via ib-insync?
With easyib (https://github.com/ashpipe/EasyIB) it is possible to connect, as they provide an ssl=False flag
ib = easyib.REST(url="https://localhost:5000", ssl=False)
Or maybe users of ibeam generally prefer to interact with the IB api directly and using something like ib-insync is actually not a good idea?
Would be grateful for any pointers. Thank you!
P.S. my error is identical to the one here by Adam Morley on4/08/20
https://groups.io/g/insync/topic/72870035?p=Created,,,20,2,0,0
His error, which is identical to mine:

ib.connect(host="localhost", port=5000, clientId=1)
2020-04-08 03:13:20,819 ib_insync.client INFO Connecting to localhost:5000 with clientId 1...
2020-04-08 03:13:20,821 ib_insync.client INFO Connected
2020-04-08 03:13:20,825 ib_insync.client INFO Disconnected
2020-04-08 03:13:22,822 ib_insync.client ERROR API connection failed: CancelledError()
Traceback (most recent call last):
File "", line 1, in
File "/home/adam/.local/lib/python3.6/site-packages/ib_insync/ib.py", line 261, in connect
host, port, clientId, timeout, readonly, account))
File "/home/adam/.local/lib/python3.6/site-packages/ib_insync/ib.py", line 292, in _run
return util.run(*awaitables, timeout=self.RequestTimeout)
File "/home/adam/.local/lib/python3.6/site-packages/ib_insync/util.py", line 311, in run
result = loop.run_until_complete(task)
File "/usr/lib/python3.6/asyncio/base_events.py", line 484, in run_until_complete
return future.result()
File "/home/adam/.local/lib/python3.6/site-packages/ib_insync/ib.py", line 1619, in connectAsync
await asyncio.wait_for(connect(), timeout or None)
File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
raise futures.TimeoutError()
concurrent.futures._base.TimeoutError

Or maybe my confusion comes from the fact that documentation for ib-insync and other libraries were made for tws-api? These libraries mention all about the needs for handling websockets and async, callbacks etc. and say they help by encapsulating all of that in their library.
But it's dawning on me that the client web portal api might be radically simpler and therefore there might not be a need for any third party library?

This is the conclusion I came to! It was simple enough if you follow the client web api not to need those wrappers. I did use “easyib” for the actual placing of an order as it deals nicely with replying to the confirmation messages to confirm an order

Hey @alderaan thanks for trying out IBeam and for the kind words 😊
As you and @freekeys figured out - ib_insync is used for the TWS Gateway, not CP Web Gateway which IBeam is used to maintain. Unfortunately this isn't very clear in the way things are named.
Indeed the second library you list - EasyIB - should be able to work just fine 👍


Better Edge Tag Naming

Quick PR to improve Edge tag naming and allow for longer tag names.
Should resolve Issue #78

@JoeyT1994 some other improvements:
vertex_tag(v) = replace("$v", "," => "×", "(" => "", ")" => "")

on line 2 of indextags.jl and:
    is[v] = [siteind(sitetypes[v], vertex_tag(v); kwargs...)]

on line 15 of sitetype.jl.

Sure added them!

Okay I have mode those changes and all seems to be passing now.


Could not read the Calendar

Describe the bug
When I open the app, I get a spinning wheel. Then I click on anything and get the Could not read the calendar message box.
To Reproduce
When I open the app, I get a spinning wheel. Then I click on anything and get the Could not read the calendar message box.
Expected behavior
Nothing, Calendar automatically updates
Screenshots
If applicable, add screenshots to help explain your problem.

Windows Version
Windows 10 x64 1903 18362.778
Additional context and log file
Add any other context about the problem here
Also upload the most recent log file located in C:\Program Files (x86)\Outlook on the Desktop\logs [2020-04-23.log](https://github.com/mscrivo/OotD/files/4525944/2020-04-23.log)

This is an Outlook bug, see here for possible workaround: https://social.technet.microsoft.com/Forums/ie/en-US/5bf4ad1b-e8fc-40a2-8cdd-5970cfb66b27/outlook-2010-could-not-read-the-calendar?forum=outlook

Thanks for the feedback. I have followed all the workarounds from that discussion but I continue having the same issue. Unfortunately, I will not be able to use your app (and I really wanted)
Regards,
Alfredo
Email Classification: Business Use (unless specified differently above)
From: Michael Scrivo<EMAIL_ADDRESS>Sent: Friday, August 14, 2020 9:07 PM
To: mscrivo/OotD<EMAIL_ADDRESS>Cc: Colas, Alfredo<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [mscrivo/OotD] Could not read the Calendar (#141)
This is an Outlook bug, see here for possible workaround: https://social.technet.microsoft.com/Forums/ie/en-US/5bf4ad1b-e8fc-40a2-8cdd-5970cfb66b27/outlook-2010-could-not-read-the-calendar?forum=outlook
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/mscrivo/OotD/issues/141#issuecomment-674326382, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AO6QVKPAJJVCURYF6E2TPE3SAXNSTANCNFSM4MPVAZ4Q.


Cleanup unused branches

I notice that there are a total of 29 branches and a lot of them are stale. I think it would be good to clean this up so that users doesn't get confused and it looks cleaner too 😄

All branches with no content have been purged. Next I'll go through the remaining ones to see which get to live

Ok, I've purged all branches that have fallen too far behind. The remaining ones have content to be considered / are in active development.

Thanks @ConnorStoneAstro! I'll consider this as DONE.


New HTTP v2 server

[x] Status
[x] Metadata
[x] Infer (Without Shared Memory, Only Flat Json Array I/O)

@CoderHam This needs to be manually rebased.


Update docker image version for cloud build triggers

Added golang to developer-tools-light https://github.com/GoogleCloudPlatform/cloud-foundation-toolkit/pull/1245

/gcbrun

/gcbrun

/gcbrun

/gcbrun