Error when building to IOS

When building to IOS I receive the following error:
C:\Users\MyName.nuget\packages\xamarin.build.download\0.10.0\buildTransitive\Xamarin.Build.Download.targets(52,3): error : Object reference not set to an instance of an object
I tried the SampleApp code and jfversluis/XFAlternativeBarcodeScanningSample (Gerald sample) and got this error.  Even in a blank project, if I add the nuget BarcodeScanner.XF, after that the build fail. Android build succeeded. The build error just happen on IOS.
I am using Visual Studio 2019 (Windows) version 16.11.3 (I tried 16.10.4 too). Xamarin <IP_ADDRESS>. Xamarin IOS <IP_ADDRESS>. Xcode 12.5.1. macOS BigSur 11.6. Xamarin Forms <IP_ADDRESS>2 (tried other versions too). BarcodeScanner.XF 5.0.9 (tried 6.1.0-pre too).
Edited:
Now I noticed that when I add this nuget (BarcodeScanner.XF) to my solution the error appears immediatily on "Error List" view (Description: Object reference not set to an instance of an object; File: Xamarin.Build.Download.targets; Line 52). And I can't see  BarcodeScanner in my IOS project references (but I can see in my Android Project).
I am thinking the problem is it dependency, because I try to add the nuget package Xamarin.Firebase.IOS.Core and the same error happen. But I've tried everything to fix it and nothing works.
I would really appreciate some help.

Did you try to install
https://www.nuget.org/packages/Xamarin.Build.Download/0.4.5
to your project?

Did you try to install
https://www.nuget.org/packages/Xamarin.Build.Download/0.4.5
to your project?

Yes, I did.
I've been working with Xamarin since 2016. Mainly in the beginning there were many bugs, but I always managed to solve them. It's the first time I see a problem that, after researching a lot on the internet, that I can't solve and that doesn't seem to happen with many colleagues.
I've also tested it on two different Windows computers and the only thing in common is my Mac Mini, but I don't think it would cause this problem.
Probably BarcodeScanner.XF is not the root cause of the problem, but I appreciate the help of any colleague with any ideas.

For me, there are 3 ways for me to try
1.
1. close my visual studio
2. remove all bin/obj folder in the projects
3. open the project and rebuild

you may also try to remove nuget cache

https://docs.microsoft.com/en-us/nuget/consume-packages/managing-the-global-packages-and-cache-folders

It will take time to download all the package again.

 repair the external hdd if your project is located in there

Unfortunately I've tried all of them (except 3 for not using external hard drive) and none of them worked.
Thank you so much @JimmyPun610 for the tips.
I'll keep trying and if new ideas come up, I appreciate it.


[Feature]: Pair down the template generated by create-remix to be minimal needed to get started

What is the new or updated feature that you are suggesting?
Update create-remix to generate a template that is minimal and easy to understand.
Why should this feature be included?

The template generated by create-remix is too large. I always have to delete a bunch of stuff and make tweaks to adapt to the specific requirements at hand.
Spinning up a new project becomes a chore. I would rather start with minimal "Hello world" app and add features as needed. Ideally the template should have just a home page with some text - no logos or other assets that I need to delete.
root.tsx is too complex and I don't understand every feature it is trying to provide (such as different layouts).

In general, it would be better to identify the various features that the current template is trying to demonstrate and introduce them via examples instead of overloading them in the template.
Nice to have
Document a way to extend the template. For example,

How to add other dependencies to package.json? (e.g. Prettier)
How to customize root.tsx and the index page?

We intend to trim it down considerably soon, we just wanted it to serve as documentation for the launch.
In the mean time you can always make your own GitHub repo with the boilerplate you want and clone that instead of using create-remix :)

The initial template is not simpler


[Bug]: collection.query RuntimeError: Cannot open header file

What happened?
1. init data

chroma_client = chromadb.PersistentClient(path=str(collection_dir))
chroma_collection = chroma_client.get_or_create_collection(name=collection_name)
add some data chroma_collection.upsert(ids=[id], embeddings=[embedding], documents=[document], metadatas=[metadata])
stop this program

2. query and RuntimeError except

collection.query(query_embeddings=query_embeddings, n_results=100)

3. remove index_metadata.pickle

rm 64597cda-24ba-4d7a-8fc4-b96f1fc098d9/index_metadata.pickle

4. query and no RuntimeError except
5. restart program and  query and RuntimeError except
6. remove index_metadata.pickle and restart program and  query and RuntimeError no except
so, when index_metadata.pickle exists, will except RuntimeError
Versions
chromadb 0.4.2
python 3.11.4
windows 11
Relevant log output
Call function: query_result = collection.query(query_embeddings=query_embeddings, n_results=100)

File "python-env\Lib\site-packages\chromadb\api\models\Collection.py", line 223, in query
    return self._client._query(
           ^^^^^^^^^^^^^^^^^^^^
  File "python-env\Lib\site-packages\chromadb\api\segment.py", line 433, in _query
    vector_reader = self._manager.get_segment(collection_id, VectorReader)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "python-env\Lib\site-packages\chromadb\segment\impl\manager\local.py", line 112, in get_segment
    instance = self._instance(self._segment_cache[collection_id][scope])
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "python-env\Lib\site-packages\chromadb\segment\impl\manager\local.py", line 131, in _instance
    instance = cls(self._system, segment)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "python-env\Lib\site-packages\chromadb\segment\impl\vector\local_persistent_hnsw.py", line 107, in __init__
    self._init_index(self._dimensionality)
  File "python-env\Lib\site-packages\chromadb\segment\impl\vector\local_persistent_hnsw.py", line 149, in _init_index
    index.load_index(
RuntimeError: Cannot open header file

when removing index_metadata.pickle it can work,
if index_metadata.pickle exists, it will except RuntimeError

@huanggefan i see. our tests havent been able to pick this up, and we do test this quite a bit.
here are a few ideas from chatgpt...
The error traceback you've provided suggests that the program is having trouble opening a file, specifically a header file. This could be due to a number of reasons:

File Doesn't Exist: The file it's trying to open might not exist. Verify that the file is indeed present at the expected location.

Incorrect Path: If the file does exist, make sure the program is looking for it in the right place. The path might be relative or absolute. If it's relative, it's relative to the working directory when you started the program.

File Permissions: The program may not have sufficient permissions to open the file. Check the permissions on the file and ensure that the user running the program has the necessary permissions to read the file.

File is Being Used by Another Process: The file could be locked or being used by another process. Make sure no other processes are using the file when you're trying to run your program.

To resolve this issue, try to manually access the file path the software is trying to use. If you can access it, and the file is there, check if the file is locked or if the process has appropriate permissions to access it. Also, ensure that the file is not currently being used by another process. If all these are fine, the problem might be with the software itself - perhaps it's not handling paths correctly or it's incorrectly formulating the path to the file.

This error indicates the index did not intialize or save.
Does the file  64597cda-24ba-4d7a-8fc4-b96f1fc098d9/header.bin exist?

I run as local
chroma_client = chromadb.PersistentClient(path=str(self.collection_dir))
chroma_collection = chroma_client.get_or_create_collection(name=self.name)

chroma_collection.upsert(ids=[i_d], embeddings=[chunk_embedding], documents=[document_chunk], metadatas=[metadata])
...

chroma_client.stop()

only index_metadata.pickle, no header.bin
@HammadB

Hmmm, that does not make sense. What version of chroma-hnswlib do you have installed?

chromadb 0.4.2
python 3.11.4
windows 11
@HammadB

i find chroma_hnswlib at env\Lib\site-packages\chroma_hnswlib-0.7.1.dist-info
chroma_hnswlib 0.7.1
@HammadB

i try use chroma_hnswlib 0.7.2, but look the same error: RuntimeError: Cannot open header file
@HammadB

I found the key to the problem

when collection_dir at disk (SDD or HDD), [data_level0.bin, header.bin, length.bin, link_lists.bin], these files do not exist
when collection_dir  ** at memory** (RamDisk), both  *.bin files exist, and everything is normal now

@HammadB

I found the key to the problem

when collection_dir at disk (SDD or HDD), [data_level0.bin, header.bin, length.bin, link_lists.bin], these files do not exist
when collection_dir at memory (RamDisk), both  *.bin files exist, and everything is normal now

@HammadB

here is my code issues 872
run it python collection/zh_wikipedia_org.py
need install tqdm
@HammadB

@huanggefan - interesting. I will take a look at your code. But to me this implies something strange with the ability to create and use the files on SDD vs other disk types. Do you have any insight into your specific platform and why this might be the case?

I set collection_dir to RamDisk and ran the code for a while. After that, I found a clean folder on the SSD, clear collection_dir and re-imported the data. Surprisingly, everything is working fine now.
This problem is quite strange now. I'll try restarting the computer a few times and check it out after I finish work.

I set collection_dir to RamDisk and ran the code for a while. After that, I found a clean folder on the SSD, clear collection_dir and re-imported the data. Surprisingly, everything is working fine now.
This problem is quite strange now. I'll try restarting the computer a few times and check it out after I finish work.
@HammadB

at now version:
chroma-hnswlib             0.7.2
chromadb                      0.4.7
When I noticed that the disk was no longer writing data, meaning that files like index_metadata.pickle were no longer changing
I have encountered this error，I'm not sure if this is related to the issue.
Exception occurred invoking consumer for subscription acc30d643e2541a7bc0eebf1caec76e2to topic persistent://default/default/1ea6b644-e293-4cdf-ae8c-35e709d9ad8d Index with capacity 100 and 100 current entries cannot add 1 records

@HammadB @jeffchuber

I experienced this same phenomenon when using Japanese directory names.
I solved this problem by using English directory names.

I think we should atomically rename a new index_metadata instead of overwriting. I can only suspect that the file got corrupted

I am having the same probelm.
I run my code on Google Colab.
# Chroma Location
chroma_location = "chroma_24_nov_2023"
vectorDBlocation = os.path.join("/content/drive/My Drive/", chroma_location)
client = chromadb.PersistentClient(path=vectorDBlocation)

# Embedder
sentence_transformer_ef = embedding_functions.SentenceTransformerEmbeddingFunction(model_name="all-mpnet-base-v2", device=processing_device)

# collection_name
collection_name = 'ABC_Collection'

distance = 'cosine'

 # Get a collection object from an existing collection, by name. If it doesn't exist, create it.
collection = client.get_or_create_collection(name=collection_name,
                                             embedding_function=sentence_transformer_ef,
                                             metadata={"hnsw:space": distance})

# Use this function to add data to the collection
def add_to_collection(ids, text_chunks, extended_meta_data):
    collection.add(
        ids=ids,
        documents=text_chunks,
        metadatas=extended_meta_data
    )

The code was running fine the first time data was added to the collection. When I restarted the kernel and tried to use the system the next morning, I started getting the same error.
For example collection.peek(), returned the following error:
---------------------------------------------------------------------------
RuntimeError                              Traceback (most recent call last)
[<ipython-input-18-d0cc5020d39d>](https://localhost:8080/#) in <cell line: 1>()
----> 1 collection.peek()

10 frames
[/usr/local/lib/python3.10/dist-packages/chromadb/api/models/Collection.py](https://localhost:8080/#) in peek(self, limit)
    235             GetResult: A GetResult object containing the results.
    236         """
--> 237         return self._client._peek(self.id, limit)
    238
    239     def query(

[/usr/local/lib/python3.10/dist-packages/chromadb/telemetry/opentelemetry/__init__.py](https://localhost:8080/#) in wrapper(*args, **kwargs)
    125             global tracer, granularity
    126             if trace_granularity < granularity:
--> 127                 return f(*args, **kwargs)
    128             if not tracer:
    129                 return f(*args, **kwargs)

[/usr/local/lib/python3.10/dist-packages/chromadb/api/segment.py](https://localhost:8080/#) in _peek(self, collection_id, n)
    745     def _peek(self, collection_id: UUID, n: int = 10) -> GetResult:
    746         add_attributes_to_current_span({"collection_id": str(collection_id)})
--> 747         return self._get(collection_id, limit=n)  # type: ignore
    748
    749     @override

[/usr/local/lib/python3.10/dist-packages/chromadb/telemetry/opentelemetry/__init__.py](https://localhost:8080/#) in wrapper(*args, **kwargs)
    125             global tracer, granularity
    126             if trace_granularity < granularity:
--> 127                 return f(*args, **kwargs)
    128             if not tracer:
    129                 return f(*args, **kwargs)

[/usr/local/lib/python3.10/dist-packages/chromadb/api/segment.py](https://localhost:8080/#) in _get(self, collection_id, ids, where, sort, limit, offset, page, page_size, where_document, include)
    508         if "embeddings" in include:
    509             vector_ids = [r["id"] for r in records]
--> 510             vector_segment = self._manager.get_segment(collection_id, VectorReader)
    511             vectors = vector_segment.get_vectors(ids=vector_ids)
    512

[/usr/local/lib/python3.10/dist-packages/chromadb/telemetry/opentelemetry/__init__.py](https://localhost:8080/#) in wrapper(*args, **kwargs)
    125             global tracer, granularity
    126             if trace_granularity < granularity:
--> 127                 return f(*args, **kwargs)
    128             if not tracer:
    129                 return f(*args, **kwargs)

[/usr/local/lib/python3.10/dist-packages/chromadb/segment/impl/manager/local.py](https://localhost:8080/#) in get_segment(self, collection_id, type)
    157         # creates the instance.
    158         with self._lock:
--> 159             instance = self._instance(self._segment_cache[collection_id][scope])
    160         return cast(S, instance)
    161

[/usr/local/lib/python3.10/dist-packages/chromadb/segment/impl/manager/local.py](https://localhost:8080/#) in _instance(self, segment)
    186         if segment["id"] not in self._instances:
    187             cls = self._cls(segment)
--> 188             instance = cls(self._system, segment)
    189             instance.start()
    190             self._instances[segment["id"]] = instance

[/usr/local/lib/python3.10/dist-packages/chromadb/segment/impl/vector/local_persistent_hnsw.py](https://localhost:8080/#) in __init__(self, system, segment)
    117             if len(self._id_to_label) > 0:
    118                 self._dimensionality = cast(int, self._dimensionality)
--> 119                 self._init_index(self._dimensionality)
    120         else:
    121             self._persist_data = PersistentData(

[/usr/local/lib/python3.10/dist-packages/chromadb/telemetry/opentelemetry/__init__.py](https://localhost:8080/#) in wrapper(*args, **kwargs)
    125             global tracer, granularity
    126             if trace_granularity < granularity:
--> 127                 return f(*args, **kwargs)
    128             if not tracer:
    129                 return f(*args, **kwargs)

[/usr/local/lib/python3.10/dist-packages/chromadb/segment/impl/vector/local_persistent_hnsw.py](https://localhost:8080/#) in _init_index(self, dimensionality)
    162         # Check if index exists and load it if it does
    163         if self._index_exists():
--> 164             index.load_index(
    165                 self._get_storage_folder(),
    166                 is_persistent_index=True,

RuntimeError: Cannot open header file

And when I look at the "chroma_24_nov_2023" directory I only see the "chroma.sqlite3" in the main folder and a single file called "index_metadata.pickle" in the "8c313532-435c-45a4-97dc-46b92f45e71a" directory

But strangely, when I deleted the "8c313532-435c-45a4-97dc-46b92f45e71a" directory and run the code again, it works. I get a new directory called "8c313532-435c-45a4-97dc-46b92f45e71a" (The exact same name as before) but everything works now!
This is a serious problem if we want to use this code in production!
Any fix?

I have the same problem, there is no solution?

I also encountered the same problem, there is only one index_metadata.pickle file in the folder, after running the search error, cannot open header file, and subsequently cannot add files and search documents in this collection, may I ask anyone to solve it?

In my opinion, it's because there is 1000 limited data of the database. if you change the number 1000 into 10000 in all of the py file, you may solve the problem.
---- Replied Message ----
| From | @.> |
| Date | 06/03/2024 15:22 |
| To | @.> |
| Cc |<EMAIL_ADDRESS>|
| Subject | Re: [chroma-core/chroma] [Bug]: collection.query RuntimeError: Cannot open header file (Issue #872) |
I also encountered the same problem, there is only one index_metadata.pickle file in the folder, after running the search error, cannot open header file, and subsequently cannot add files and search documents in this collection, may I ask anyone to solve it?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you commented.Message ID: @.***>

Thank you, I found the reason, is the folder needs to be named in English, otherwise there will be this error. @okamura-0422

在我看来，这是因为数据库有 1000 个有限的数据。如果将所有 PY 文件中的数字 1000 更改为 10000，则可以解决问题。
…
----回复了消息 ---- |从<EMAIL_ADDRESS>| |日期 |2024-06-03 15：22 | |至<EMAIL_ADDRESS>| |抄送 |<EMAIL_ADDRESS>| |主题 |回复：[chroma-core/chroma] [Bug]：collection.query RuntimeError：无法打开头文件（问题 #872）| 我也遇到了同样的问题，文件夹中只有一个index_metadata.pickle文件，运行搜索错误后，无法打开头文件，随后无法在此集合中添加文件和搜索文档，我可以请任何人解决吗？ — 直接回复此电子邮件，在 GitHub 上查看或取消订阅。 您收到此消息是因为您发表了评论。消息<EMAIL_ADDRESS>
Thank you, I found the reason, is the folder needs to be named in English, otherwise there will be this error

In my opinion, it's because there is 1000 limited data of the database. if you change the number 1000 into 10000 in all of the py file, you may solve the problem.
…
---- Replied Message ---- | From | @.> | | Date | 06/03/2024 15:22 | | To | @.> | | Cc |<EMAIL_ADDRESS>| | Subject | Re: [chroma-core/chroma] [Bug]: collection.query RuntimeError: Cannot open header file (Issue #872) | I also encountered the same problem, there is only one index_metadata.pickle file in the folder, after running the search error, cannot open header file, and subsequently cannot add files and search documents in this collection, may I ask anyone to solve it? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

Thank you, I found the reason, is the folder needs to be named in English, otherwise there will be this error

Можно удалить файл index_metadata.pickle и всё заработает!
Указание пути к файлу index_metadata.pickle
index_metadata_path = PATH_DB_+'/a4f2f538-d3b2-4906-81b9-de5e77c40d9e/index_metadata.pickle'
Удаление файла, если он существует
if os.path.exists(index_metadata_path):
os.remove(index_metadata_path)
print(f"Файл {index_metadata_path} был удален.")

Исправлять название папок на англоязычные нужно до того как файл index_metadata.pickle будет автоматически создан базой при первом обращении к ней. Короче, сначала его нужно удалить, а потом исправлять название всего пути на англоязычные папки. В этом случае, когда файл index_metadata.pickle создастся очередной раз при обращении к базе, там уже всё будет корректно и в дальнейшем его не нужно будет удалять. Изначальная причина ошибок в русскоязычных названиях папок в адресе расположения базы данных.

I'm bumping into a similar problem using colab with google drive.
`/usr/local/lib/python3.10/dist-packages/chromadb/segment/impl/vector/local_persistent_hnsw.py in _init_index(self, dimensionality)
206         # Check if index exists and load it if it does
207         if self._index_exists():
--> 208             index.load_index(
209                 self._get_storage_folder(),
210                 is_persistent_index=True,
RuntimeError: Cannot open data_level0 file`
First time making the collection, everything works just fine.
But cannot load the db again.
The file is just not being created.
I don't have non-eng characters in the path.
I'm going to downgrade the chromadb version and try see if .persist() can force create the file.

Hi there. Seems like there are several issues here, and we apologize we didn't get to a complete resolution in a timely manner. We made many improvements to Chroma in the meantime in versions 0.5.x. If you still have this issue with up-to-date Chroma please open another issue and we will do our best to tackle it right away.


fix(docs): update ion-segment sample codes

Adapt docs to 4.0.0-beta.16 breaking change
Short description of what this resolves:
In the changelog, version beta.16 cited a breaking change for ion-segment usage, that was not reflected in the docs.
Changes proposed in this pull request:

Update the docs according to the changelog.

Ionic Version: beta.16 and later.
Fixes: #

Thank you for the PR! The code in the README is actually generated from the following files: https://github.com/ionic-team/ionic/tree/master/core/src/components/segment/usage
Could you update the code in these files and then run npm run build in order to update the build files? Thank you. 🙂

Thank you! 🙂


make more explizit that redoc is reversable / allows for a round trip .Rmd -> .docx -> .Rmd

This sounds to good to be true. When does it break?

Unfortunately, the development is suspended. Of course, you can not edit the results of R code chunks, and expect this to work. I also don't know how well formatting changes (beyond markdown possible stuff) is handled. Most likely changing references won't work and Open Office is not supported. But beyond these limitations it works pretty well.


Remove NSX-T 2.2 and vSphere 6.7 from PKS 1.1 supported configurations

Per team decision.

Thanks, @ericivorychambers !


Use "babel-eslint" as parser for ESLint

With Babel we can use a lot of syntax sugar - it's cool, but ESLint ain't able to fit the things.
For instance, class properties aren't available. More information can be found here: https://github.com/babel/babel-eslint/issues/312

Coverage remained the same at 98.571% when pulling 36ed132b9dc3f835f0de63939b5f073b62aeaf80 on BR0kEN-:feature/class-properties into c062a9e9f0cd271d7f6c32145082c89c3d3f2e78 on coryhouse:master.

I'm torn on this. I took this out because it's only necessary for those running experimental features. But I totally understand why some would want to use them, so I'll go ahead and accept. Thanks for the PR. 👍


Email subscription section

The theme supposedly has an email subscription section

but I can't find it.
Any help will be much appreciated.

Hello @rodrigoalcarazdelaosa
I am sorry this feature is not available, If you want it, we can create it for you, contact us at<EMAIL_ADDRESS>(paid)


Question about splits_final.pkl

Hi, thank you for the great work.
Following the readme and the below error occurred

Can you provide the Splits_final.pkl file?

I have sent the file to your mailbox.
But it stands to reason that running nnunet's preprocessing will automatically generate this file.

Thanks for your feedback，we fix a bug about the data split now.
The change of the data split will not be achieved in the change_plan_swin.py.
Now, when you run the command
nnFormer_train 3d_fullres nnFormerTrainerV2_ACDC 1 0
nnFormer_train 3d_fullres nnFormerTrainerV2_Synapse 2 0

The Splits_final.pkl file will be generated automatically


Added missing small RPi images

I forgot to add the small versions of the RPi images last time I updated the platform list, which shows broken image links on the platform page now. Mea culpa.

I landed #104


Add optional detectionTool field to CodeTF result

This doesn't entirely address #17 but I think it adds a small, required set of fields that we definitely want.
In a subsequent change we can add findings which offers details about which findings were remediated and which were not.
We can build upon this as necessary but for now I hope we can come to an agreement on the field names.
Part of the goal here is to enable consistent reporting of tool remediation by upstream tools. Rather than encoding things like the tool name in the summary we can enable consistent handling.

Closing since this is superseded by #20 and #21


lots of refactoring

Thanks for this, this looks pretty great in general. There are a couple things I don't like.

The change from createSocket -> socket. Both http and net in node.js use the create* for factory functions, though if it was a constructor like net.Socket, that might also be ok.
bind is now synchronous. Bind in the net and http modules is async, and bind is blocking in zeromq, so I think it should remain async.
The documentation is pretty sparse.

Love the tests though!
What do you think about making those changes?

node's core api is changing a bit with that actually (though still backwards compatible) http.createServer(fn) -> http.Server(fn). Doesn't hurt to just alias it, the .socket() is more zmq-like and createSocket() is more node-like

Oh yeah, you're right. Now I don't know whether I want zmq.Socket, zmq.socket, or zmq.createSocket. Probably should not have all 3.
Still totally into the async bind thing, though open to providing bindSync as well. I can probably implement that and merge unless you feel strongly about this.

Oh wait, you have both now, the docs just don't use bindSync.
Alright, this looks good.

PS: I really wish github provided side-by-side diff views for reading large diffs like this.

haha yeah i know hey, i would love that too


When speed is to high, the ball can fly through paddle

Annoying bug,
tried to fix it but i did not find a working solution.
I think the problem is with collision checking. calculated ball X skips paddle.

Will try to find a fix for it on Saturday.
This is needed to be fixed for eval

Will try to find a fix for it on Saturday.
This is needed to be fixed for eval

Did not reproduce this bug. Marking it as complete


<meta name="keywords" and <meta name="keywords" should be based on page content

Fixed <meta name="keywords" and <meta name="keywords" should only exist on the front page.

Why? Sorry, I don't get it.

@freedit-dev
Basically it's the same thing as <meta property="og:title" and <meta property="og:description".  Fixing the same <meta name="keywords" and <meta name="description" on every page is a disaster for seo, please withdraw this update!


Error in prepare_submission.py

Hi,
Thank you for the amazing work! I got an error when I run prepare_submission.py.
(my cmd: python prepare_submission.py --quality_file generations/google_flan_t5_small/quality/preds.jsonl  --xxxxxxx)

Could you help me to take a look at it? Thanks!

One additional information is that the output file I generated is .jsonl (not .json). And it looks like this:

@UriSha Could you help me to take a look at this? I think there is something wrong with the json writing part in the original code (hf/run_hf_model.py). Thanks!

Hi @yuzhenmao,
Thanks!
You are absolutely right, sorry and I will push a fix to the writing end soon :)
For now you can rewrite your predictions files with something like:
import json

input_file_path = 'your/path/gov_report/predictions.jsonl'
output_file_path =  'your/path/gov_report/predictions.json'

preds = {}

with open(input_file_path, 'r') as input_file:
    for line in input_file:
        json_data = json.loads(line)
        preds[json_data['id']] = json_data['prediction']

with open(output_file_path, 'w') as output_file:
    json.dump(preds, output_file)

Thanks, @UriSha !

Sure, thank you!
Just pushed the fix.


Add print-only url to rustup doc, fix #1288

Sorry for the earlier one, this is the complete commit.

:umbrella: The latest upstream changes (presumably #1390) made this pull request unmergeable. Please resolve the merge conflicts.


Add files via upload

Pull Request Test Coverage Report for Build 201

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 198:
0.0%

Covered Lines:
58

Relevant Lines:
58

💛  - Coveralls


plugins/vim-colemak: init

Integrate the vim-colemak plugin.

What is the difference with https://github.com/linduxed/colemak.nvim ?
If both are doing the same, maybe we should choose which one to add (and have it named plugins.colemak).

@GaetanLepage I have not used that plugin. This plugin (mine) is forked from this one with the motion (hjkl on qwerty) moved to neio the keys on the home row for the right hand on the colemak keyboard layout. I submitted a PR years ago but it was never merged.
I have not evaluated the colemak.nvim but I took a quick look at it, and from the README:

unei (ijkl on QWERTY) replaces hjkl

Makes it immediately a no-go for me as it moves the home-row motion into a reverse T style arrow key movement (the u is above e, n to the left of e and i to the right) and that's moving away too far from how Vim typically works with the flat-style motion.

@GaetanLepage I have not used that plugin. This plugin (mine) is forked from this one with the hjkl motions moved to neio the keys on the home row [...]
I have not evaluated the colemak.nvim but I took a quick look at it, and from the README:

unei (ijkl on QWERTY) replaces hjkl

Makes it immediately a no-go for me as it moves the home-row motion into a reverse T style arrow key movement [...]
I also do not see it packaged in nixpkgs.

So to summarise, we have three plugins with the same goal (making vim more colemak friendly) but different strategies. Of those, this is the only one packaged in nixpkgs?
I can see a case for simplicity; naming the plugin simply "colemak"... But it also seems conceivable that (down the line) some users may wish to package and use the other competing plugins instead. On that basis, I think the current "vim-colemak" name is the best choice.

As an aside; neio are all fairly fundamental actions in vim, many with a mnemonic relation to what they do; n next, e end of word, i insert, o open new line.
Therefore, even as a colemak user myself, I've avoided these kinda rebindings. I'm curious how you find this affects your other keybinds?

@MattSturgeon Thanks for your review and approval.

As an aside; neio are all fairly fundamental actions in vim, many with a mnemonic relation to what they do; n next, e end of word, i insert, o open new line.
Therefore, even as a colemak user myself, I've avoided these kinda rebindings. I've also held back to maintain consistency with other programs that have vi-style keybindings, e.g. pagers like less that are often used by things like git.
I'm curious how you find this affects your other keybinds?

It hasn't been easy, but doable. Most programs allows some level of custom keybing, including less using the less-known lesskey program that can adjust its keybinding; See this module I created for it: https://github.com/SoxinOS/soxin/blob/main/modules/programs/less/default.nix
The vim-colemak moves things around to allow me to use neio for motion, and I do the same for all other applications I use. This also forces me to change some settings for (n)vim plugins in order to change their default keybinding, for instance NeoTree, (or multicursors that I'm trying to integrate currently); I'm consolidating my work on the plugins here.

Ok, this was indeed the motivation behind my question: If we could want at some point to have several of those plugins in nixvim, it is better to anticipate and have it named vim-colemak.

@mergify queue


View and cancel any in-progress simulations

Checked for duplicates
No - I haven't checked
Alternatives considered
No - I haven't considered
Related problems
I'm frustrated when I open my laptop, the CPU is 300% from the docker merlin-worker, and I can't tell from the 20 plans I have on the server which ones are still simulating so that I can cancel them.  I have to open each plan and see if there is one running.
Describe the feature request
I need or want to see if simulations are in progress for each plan on the plans page and have the option to cancel them there.  Now, I expect with multiple merlin-workers you might have multiple simulations for a single plan.  That might complicate things.  There may be a better place to convey the information--I just see the plans page a lot and thought that would be a good place.  It could be on the mission models page instead or in addition.  Maybe a button from the top menu bar with a dropdown would be better.  I dunno.

I updated the title to remove the "from the plans page" requirement - while that may turn out to be the best place to put this information, I'd like to leave that design aspect open-ended

And, to be clear, one button to cancel them all is not what I'm requesting.  I want to cancel individual simulations.

Care should be taken to not allow users to cancel simulations started by different users

Exploring some different treatments and locations:
As column with popover

**As column, but instead of a popover show simulation history in plan details on plan page. **

Separate tab that shows simulations

In a pop up, show all active simulations and the plan they relate to

Ready for dev link: https://www.figma.com/design/h0bxGMISEMUx0iFrjWSBSK/Aerie-%231323-View-and-Cancel-any-in-progress-simulations?node-id=12-1140&t=tDHSyZ22iJBjIJu9-4

When we add simulation arguments to simulation history component, we should show those here too. https://github.com/orgs/NASA-AMMOS/projects/2/views/19?filterQuery=arguments&pane=issue&itemId=36686303


Strange Redirection Problem with Xonsh Interactive Login Shell in mlterm

I cannot tell if this is something strange I have done with my mlterm configuration, which is minimal, or my new xonsh configuration.  I usually use emacs as a term multiplexer these days, and mlterm was a hold-over for complex script languages I read and sometimes use.  I am unable to delete a file when prompted, it immediatetly throws an error when prompted for user input.
me@computer ~ $ mlterm -v
mlterm version 3.7.0
me@computer ~ $ import xonsh
me@computer ~ $ xonsh.__version__
'0.2.6'
me@computer ~ $ import prompt_toolkit
me@computer ~ $ SHELL_TYPE=prompt_toolkit
me@computer ~ $ prompt_toolkit.__version__
'0.60'
me@computer ~ $ rm ~/Code/conf.py
/usr/bin/rm: remove regular file '/home/me/Code/conf.py'?
*[1] stopped: rm /home/me/Code/conf.py & (10123)
TypeError: unorderable types: NoneType() > int()

For the last line, if I redirect output with xclip to speed up copy-paste for this ticket, redirection magically is fine and I can actually answer yes or no.

me@computer ~ $ rm ~/Code/conf.py | xclip -sel clip
/usr/bin/rm: remove regular file '/home/me/Code/conf.py'?

My dotfiles are in my repo.  I just created the most minimal xonsh possible from my minimal needs with xonfig.
{
 "foreign_shells": [
  {
   "login": true,
   "shell": "bash"
  },
  {
   "shell": "bash"
  }
 ]
}

Did I wrap two login shells into each other or something basic I forgot?  I have tried running mlterm straight with the default bash shell, but also tried bypassing this and running just xonsh with mlterm -e xonsh and I get the same behavior on all attempts.

Sorry you can disregard. I foolishly copy pasted into this bug tracker when I intended for xonsh. Sorry.

No problem!


chore: remove fix-comments.py

This script has served its purpose during the port; now that all align information has been removed from mathlib, it is not useful for other projects either.
Projects which wish to use such functionality should check out the v3-eol tag and use the script from that commit.

Helps with #14539. PR #15222 (in progress) runs that script on all of mathlib, but is based on the above tag - removing it on master does not interfere with this.

I agree, now that the #aligns are actually removed, this has no use.
maintainer merge

Thanks!
bors r+


fix: fixed native cosine function

:tada: This PR is included in version 3.7.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


fix(PeriphDrivers): Add GPIO Chip Select Configuration for MAX32665 SPI driver

Description
fixes #396  . Add Chip Select configuration to MXC_SPI_Init using pre-existing me14_pins gpio cfg structs. SPI Example tested showing successful transactions and proper SPI Chip Select Behavior.

Second image shows green LED1 on EVK, which indicates a successful run of the SPI example.
Types
fix
Scopes
PeriphDrivers

Hey @Brandon-Hurst just some formatter/linter errors in the auto checks.  See Style Guide

Hey @Brandon-Hurst just some formatter/linter errors in the auto checks. See Style Guide

Thanks Jake, I fixed these with a new commit. Just a line of extra whitespace caused it to complain. Let me know if I need to squash and I can do that later to get this in.

Thanks Brandon, no worries on the squash.  We squash and merge into main


First Pass: Deployment to LZ0 using GitHub actions

Overview of some changes

Made updates to allow deploying to LZ0 over GitHub actions
Removed the ARM64 arch given its not selected for the GitHub runner. Was relevant for use from my workstation

Testing

Deployed and destroyed resources to LZ0 via the cpf-1068 branch. History if tests can be found at Deploy Dev (LZ0) Resources

Changing to draft state temporarily, pending decision/agreement on deployment mechanism.


Cow: Watch gitbook.com

Cow requests the watch of the watch_keyword gitbook\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

gitbook\.com has been seen in 1 true positive, 3 false positives, and 0 NAAs.

Rejected by tripleee in Charcoal HQ. Reason: 'too FP-prone (3 FPs found)'

(Dunno why it said 3 FPs, there are actually several more. https://metasmoke.erwaysoftware.com/domains?utf8=✓&filter=gitbook.com)


Compression, for some reason, adds a newline character to the end.

This may or may not be from base64-encoding.

Turned out to be a non-issue. I was forgetting to set the -n flag on my echo commands, thereby including a newline by mistake... :smh:


Provide a clearer error message when the stree exe cannot be spawned

STR:

Install this extension, but without installing the gem. (And/or without having a ruby interpreter in your path.)
Open a Ruby source file

Outcome: useful but slightly cryptic error messages.

These are fine, but could possibly be improved.
Desired:

Human-readable error message & maybe some actionable advice ("install the gem" "install a Ruby")
Maybe we could even prompt the user to install the system gem for them, as the Solargraph extension does. This is getting awfully fancy however.

@xeger this is good to close now right?


[feature] What is the size of the scroll buffer? Add an option to increased it.

What is the size (in lines or bytes) of the scroll buffer?

It is 1000 defined at https://github.com/pvolok/mprocs/blob/08d17adebd110501106f86124ef1955fb2beb881/src/proc/mod.rs#L58C14-L58C27

Reopening. Still need to add code for reading value from parsed yaml.

I believe this has been solved now.


Camera and raycast previews don't show in subscenes

When I import a scene with a camera and/or a raycast, the previews for both disappear, I recreated this by using Oxrock's raycast demo, by converting the player node into a subscene and then reimporting it after deleting the original. I've been experiencing this in a game I'm developing as well.
Before:

After (as a subscene):

Link to Demo: https://github.com/oxrock/Godot-camera-raycasting-demo
Version used: Linux x86.64, compiled from source the same day as I posted this.

Does this happen when the raycast is a sibling of the camera, instead of a direct child?

the raycast can be independent of the camera, the problem persists.

Tested on master, both camera and raycast are visible now.

@DualMatrix Thanks !

Hmm.. I think it still could be issue for 2.x version, so I better reopen it.. @DualMatrix if you have free time can you download a 2.1.5 and check if the problem exist ?

I don't think it will be fixed in 2.1 by now, only critical bug fixes will be considered for that platform. Closing as fixed in 3.1 (potentially 3.0 too).


Fake connections for tests

Using real network connections (even over localhost) in tests is unnecessary in most cases and leads to occasional random build failures.
This branch uses the same ideas as the recently-added FakeSMSC to test various other transports, applications, and utilities.

I still want to switch all the remaining transport tests over, but the current state is ready for review. (I've split up the work into separate commits that can be reviewed independently.)

I've switched all the remaining tests except for the raven ones, because there's no easy way to inject an appropriate agent in those. This PR is now complete except for things that come up during review.

Review status: 0 of 43 files reviewed at latest revision, all discussions resolved, some commit checks pending.

Comments from the review on Reviewable.io

Reviewed 2 of 2 files at r1.
Review status: 0 of 43 files reviewed at latest revision, 1 unresolved discussion, all commit checks successful.

vumi/tests/fake_connection.py, line 208 [r1] (raw file):
Having these things patched & called without some kind of warning/logging seems like something that's going to be biting us later.

Comments from the review on Reviewable.io

Review status: 0 of 43 files reviewed at latest revision, 1 unresolved discussion, all commit checks successful.

vumi/tests/fake_connection.py, line 211 [r1] (raw file):
The patching is okay here because we're specifically operating on instances of _LoopbackTransport the we get from the loopbackAsync() machinery (unless something else has interfered with the connection setup somehow, in which case all bets are off anyway). We only patch the transport if the methods we're patching onto it don't exist, which protects us from future changes to the transport implementation.
The only feasible alternative is completely reimplementing most of twisted.protocols.loopback, which I don't particularly want to do in vumi.

Comments from the review on Reviewable.io

Reviewed 2 of 2 files at r2, 1 of 1 files at r3, 2 of 2 files at r4, 2 of 2 files at r5, 4 of 4 files at r6, 2 of 2 files at r7.
Review status: 13 of 43 files reviewed at latest revision, 1 unresolved discussion, some commit checks failed.

setup.py, line 39 [r8] (raw file):
What changed in 13.2.0 vs 13.1.0 that needs this?

Comments from the review on Reviewable.io

Reviewed 2 of 2 files at r8, 6 of 6 files at r9, 4 of 4 files at r10, 3 of 3 files at r11, 2 of 2 files at r12, 2 of 2 files at r13, 2 of 2 files at r14, 2 of 2 files at r15, 2 of 2 files at r16, 2 of 2 files at r17, 2 of 2 files at r18, 1 of 1 files at r19.
Review status: all files reviewed at latest revision, 1 unresolved discussion, some commit checks failed.

Comments from the review on Reviewable.io

Review status: all files reviewed at latest revision, all discussions resolved, some commit checks failed.

setup.py, line 39 [r8] (raw file):
IAgent was introduced there.

Comments from the review on Reviewable.io

Reviewed 2 of 2 files at r20.
Review status: all files reviewed at latest revision, all discussions resolved, some commit checks pending.

Comments from the review on Reviewable.io

:+1:

Comments from the review on Reviewable.io


JQuery UI Error on /bitcoinkeys

Machine specs: Google Chrome on RHEL 7
Clicking "Generate Keys" on the /bitcoinkeys page does not produce the printable keys, after inspecting the page it says:
Uncaught TypeError: $(...).tooltip is not a function
    at HTMLDocument.<anonymous> (bitcoinkeys.js:4)

Googling reveals this is because the .tooltip function was not included. Updating the cdn url in layout.html to the latest jquery release solved the problem. I'm not sure if this is reproducible on other setups though.

Thanks Tasya! I've reprod the error, and I'll add this fix

Fixed in #62


Remove page-level client unit testing and implement e2e (integration) tests using Cypress

Part of #248
Rationale

All of the components in design-system have unit tests run against them on every push. Thus, unit testing components and pages here is superfluous and has diminishing returns for the labor involved.
Instead, we want to test the application's critical flows end-to-end
We should continue testing components, utilities, and any other encapsulated, simply testable functions.
This should be done after the rest of the client work for #248

Here are the tasks involved. We may want to break these up into an epic later, as it's quite a lot of work.

[ ] Remove client unit tests (will happen as a part of the search-v2 work)
[ ] Install and configure Cypress, along with mock server and mock service worker
[ ] Add testing fixtures
[ ] Add e2e test for login flow
[ ] Add e2e test for change/reset password flows
[ ] Add e2e test for search, search results, and data source details flows
[ ] Add e2e test for user profile
[ ] Add e2e test for new data source request

All of the components in design-system have unit tests run against them on every push. Thus, unit testing components and pages here is superfluous and has diminishing returns for the labor involved.

@joshuagraber I'm a little confused by this phrasing -- the components have unit tests run against them, thus unit testing components is superfluous? Do you mean that there are two different systems unit testing the same components, or something else?

@maxachis Yes, I'm saying that unit testing is best for small, tightly encapsulated modules or functions.
We are continuing to run tests on any data-sources-app-specific components defined here, as well as utility functions and any other building blocks.
However, when composing those components into views, unit testing makes very little sense, in my opinion, because:

the building blocks are already unit-tested, making unit tests on views relatively superfluous.

Views combine components with asynchronous fetching logic and a lot of other side-effects, making unit testing views cumbersome and prone to flakiness.

For this reason, I think it is far more effective to integration test views.
In API terms, this would be (somewhat) analogous to the common practice of unit testing middleware and handlers, while integration testing the functionality of API endpoints.

In API terms, this would be (somewhat) analogous to the common practice of unit testing middleware and handlers, while integration testing the functionality of API endpoints.

This I understand! And your rationale makes sense! One would assume that the integration tests would capture the interactions between the various building blocks enough, and that one doesn't need to necessarily test all the interactions, particularly if they are prone to being repeatedly revised and remixed -- that's a lot of potential combinations to test for with limited testing benefit when you already have the integration tests encapsulating a lot of it.


Corrected references to WCF to use Foundation instead of Framework.

I think I got them all.
Fixes #449

Created microsoft/mcr#798


Test of new navigation organization

See the diff for what I propose

Most pages are re-inserted in here, but the "Join" (formerly "get
involved") section is mostly empty.  I would like to completely
re-work this, I will start fill it it out later.

Don't merge, this is only draft ideas.  But if good I will work
actually moving and filling stuff in soon.

Thanks! This is much better.

Replaced by #733


Slim version

Due performance issues of musl in some cases. For example in Python or PHP should be 30% slower
https://superuser.com/questions/1219609/why-is-the-alpine-docker-image-over-50-slower-than-the-ubuntu-image/1234279

Can you rebase this on master as the 2-10 has been merged :) Thanks for the great work, @radeno!

Changes done :)

ping @Starefossen this would be awesome to get merged!

@airhorns don't worry. i hope will be soon

Ping @Starefossen ... any hope of getting this merged?

Sorry for the wait. I have merged and updated the tags in Docker Hub. Will take some time before all the builds complete.


Bookmarks Bug - September Release

This issue doesn't happen for bookmarks on reports published from desktop that I had published before installing the September PBI Desktop.
For September release: appears that the bookmarks (both desktop and personal) are not saving the data for cross highlights on desktop or once published to the service.  It "looks" like it save as in the cross highlights are selected but the data is showing as if nothing is cross highlighted.  If you click the bookmark twice it works or if you are on another page of the report and click the bookmark it seems to work correctly, but not if you are already on the page or navigate to the page fresh in the browser from the url with the bookmark guid included.
Also, bigger issue, happening at the same time as the other issue: personal bookmarks do not even show up when you first load the report from the apps page; they only appear after you navigate to a different page in the same report.  Clearing cache and cookies the issue remains, snapshot below
initially pasted wrong image sorry here is the correct one:

Thanks for your comment, @jwademcg  This looks like a support request or product question rather than documentation feedback. You might find a solution in the Power BI Community. If not, try our support page.
You can also engage with the Power BI engineering team by being active in the Power BI Community.

Hi, @jwademcg -- closing this issue. It does indeed look like a support request. I hope you can get it working!


Language, exact field contents?

masterLanguage is part of multiple files, and it is defined as 2 characters
but what is considered correct, and what is wrong?
In SAP all user formatted languages are 2 characters upper case, but looking at something like ISO its 2 character lower case
Suggest to make an explicit enum list of allowed values

still relevant, https://github.com/SAP/abap-file-formats/blob/main/file-formats/intf/examples/zif_aff_example.intf.json#L5

suggest following ISO standards

it's only possible for SAP to implement this issue, as the code for JSON generation is proprietary

I see this issue as an easy low hanging fruit, impacting all files in the project => ie. it should be high priority IMHO

As mentioned above all conversions in ABAP produce 2 characters upper case (e.g. ISOLA conversion exits or transformations):

https://help.sap.com/doc/abapdocu_cp_index_htm/CLOUD/en-US/abenst_option_format.htm?file=abenst_option_format.htm#!ABAP_ADDITION_1@1@
https://help.sap.com/doc/abapdocu_cp_index_htm/CLOUD/en-US/abenabap_xslt_asxml_schema.htm

I think I would prefer using ISO 639-1 using small characters.
However, I would like to check with the team how we can convert this fast in simple transformations.

We took this topic up. Unfortunately, it turned out, that ABAP uses always upper-case language codes.

If we use the format option in transformations format language will be formatted as upper-case
see https://help.sap.com/doc/abapdocu_latest_index_htm/latest/en-US/index.htm
Even SAP's conversion exists for language fields (like the system language) convert the language to upper case.
see function modules CONVERSION_EXIT_ISOLA_* or CONVERT_SAP_LANG_TO_ISO_LANG

Both accept lower case iso codes as input (in our case deserialisation) but produce uppercase codes as output (in our case during serialisation).
Even if I personally would prefer small characters for language codes, I think we should stick to the representation ABAP uses in other places, too.
If no one disagrees, we should specify this in our repository documentation.

suggest following ISO standards

Within the last weeks, we reiterated this topic (once more) and reached out to some more colleagues. They also suggested to use ISO-standard if the language is also used outside of ABAP systems.
Since I mentioned some ABAP functionality to do language conversions in ABAP systems. For the conversion to ISO language codes they suggested to use class CL_I18N_LANGUAGES.
We planned to take this up in our current iteration (see #280)

class CL_I18N_LANGUAGES is not released, I'd expect SAP to have released stuff to convert between internal format and ISO codes

class CL_I18N_LANGUAGES is not released, I'd expect SAP to have released stuff to convert between internal format and ISO codes
I have sent your feedback to the colleagues responsible.

I've looked through https://abapedia.org/steampunk-2111-api/ but did not find anything similar

I've looked through https://abapedia.org/steampunk-2111-api/ but did not find anything similar

Yes, there is nothing, currently. As mentioned above I sent the feedback to my colleagues. They added it as request to their backlog.

I think we can close this issue. If I miss anything feel free to reopen it.


Factual presented in explanation is different from original factual

When generating counterfactual explanations then looking at the factual in the explanation structure returned, I observe small differences. Namely, the value in column "BP" changes a bit. MWE follows:
import os
import random
from urllib.request import urlretrieve

import dice_ml
from lightgbm import LGBMRegressor
import numpy as np
import pandas as pd
from sklearn.compose import ColumnTransformer
from sklearn.pipeline import Pipeline
from sklearn.preprocessing import OneHotEncoder, StandardScaler

def diabetes_df():
    url = "https://www4.stat.ncsu.edu/~boos/var.select/diabetes.tab.txt"
    # safety measure for MacOS, see
    # https://docs.python.org/3/library/urllib.request.html#module-urllib.request
    os.environ["no_proxy"] = "*"
    file_name, _ = urlretrieve(url)
    df = pd.read_csv(file_name, sep="\t").astype({"SEX": str}).astype({"SEX": "category"})
    return df.sample(200, random_state=1)

def data_and_model(df, numerical, categorical, target_column):
    np.random.seed(1)
    numeric_transformer = Pipeline(steps=[("scaler", StandardScaler())])
    categorical_transformer = Pipeline(steps=[("onehot", OneHotEncoder(handle_unknown="ignore"))])
    transformations = ColumnTransformer(
        transformers=[
            ("num", numeric_transformer, numerical),
            ("cat", categorical_transformer, categorical),
        ]
    )
    #
    X = df.drop(target_column, axis=1)
    y = df[target_column]
    clf = Pipeline(steps=[("preprocessor", transformations), ("regressor", LGBMRegressor())])
    model = clf.fit(X, y)
    return X, y, model

# Data set
df = diabetes_df()
numerical = ["AGE", "BMI", "BP", "S1", "S2", "S3", "S4", "S5", "S6"]
categorical = ["SEX"]
x_train, y_train, model = data_and_model(df, numerical, categorical, "Y")
factuals = x_train[0:1]

seed = 5
random.seed(seed)
np.random.seed(seed)

# Ask for counterfactual explanations
df_for_dice = pd.concat([x_train, y_train], axis=1)
dice_data = dice_ml.Data(dataframe=df_for_dice, continuous_features=numerical, outcome_name="Y")
dice_model = dice_ml.Model(model=model, backend="sklearn", model_type="regressor")
dice_explainer = dice_ml.Dice(dice_data, dice_model, method="genetic")
features_to_vary = ["BMI", "BP", "S1", "S2", "S3", "S4", "S5", "S6"]
explanations = dice_explainer.generate_counterfactuals(
    factuals,
    total_CFs=5,
    desired_range=[60, 90],
    features_to_vary=features_to_vary,
    posthoc_sparsity_algorithm="binary",
)
print(explanations.cf_examples_list[0].test_instance_df)
print(factuals)

And here is the output:
   AGE SEX   BMI         BP   S1     S2    S3   S4      S5  S6          Y
0   60   1  23.4  76.669998  247  148.0  65.0  3.8  5.1358  77  93.585579
     AGE SEX   BMI     BP   S1     S2    S3   S4      S5  S6
246   60   1  23.4  76.67  247  148.0  65.0  3.8  5.1358  77

Yours look like a precision issue. Mine looks even worse: the categorical feature totally flipped! See the original factual (blue "V0") and the factual in the prediction (red "V0"). Hope someone can throw light upon.


application dont execute on "npm run serve"

$ npm run serve
npm ERR! missing script: serve
npm ERR! A complete log of this run can be found in:
npm ERR!     /home/shan/.npm/_logs/2018-11-27T17_01_56_066Z-debug.log

My bad

I thoght that it was an aplication, but it is an module

i am getting this error from
npm init


RFC: Applying codecs as data augmentation

In #1108 and #1141, I am adding in-memory decoding and encoding. This allows us to apply codecs to audio Tensor, like the following way.
fileobj = io.BytesIO()
torchaudio.save(fileobj, waveform, …, format=”mp3”, compression=9)
fileobj.seek(0)
waveform, _ = torchaudio.load(fileobj)
# Note: depending on the format, the size of the tensor could be different,
# so some post processing might be necessary

Which practically gives the same result as
sox input.wav -C 9 temp.mp3
sox temp.mp3 output.wav

I am thinking of adding this codecs application as part of torchaudio’s feature. Before starting working on API specification and engineering load map, I would like to hear from the community what kind of feature would be helpful to your use case.
If you would like to use codecs as data augmentation or if there are papers that use this kind of technique. Please leave comment.
cc @mravanelli @sw005320 @pzelasko @faroit @mpariente @danpovey

I have heard people say they do this (encode+decode for augmentation), and that it was helpful when applied to data that had been through codecs, but I don't recall that any of them were published.
My suspicion is that mp3 coding, being relatively high quality, probably preserves the short-time spectrum well enough that that it wouldn't have much effect.  Typically these would be mobile-phone codecs with the bit-rate turned down far enough that the quality is affected.  Unfortunately there can be IP issues with these... it's possible the IP holders would allow their use royalty-free under some caveat, but IDK.
Also I the popularity of these codecs changes with time...

I have heard people say they do this (encode+decode for augmentation), and that it was helpful when applied to data that had been through codecs, but I don't recall that any of them were published.
My suspicion is that mp3 coding, being relatively high quality, probably preserves the short-time spectrum well enough that that it wouldn't have much effect.  Typically these would be mobile-phone codecs with the bit-rate turned down far enough that the quality is affected.  Unfortunately there can be IP issues with these... it's possible the IP holders would allow their use royalty-free under some caveat, but IDK.
Also I the popularity of these codecs changes with time...

I agree with Dan’s point that mobile phone codecs would probably be the most useful. I also know of some cases where the companies stored telephone recordings in mp3...
As a side note, mp3 has been used as a defense method against adversarial attacks (not necessarily a very strong one though). The point is there could be other applications for codecs beyond training data augmentation.

I agree with Dan’s point that mobile phone codecs would probably be the most useful. I also know of some cases where the companies stored telephone recordings in mp3...
As a side note, mp3 has been used as a defense method against adversarial attacks (not necessarily a very strong one though). The point is there could be other applications for codecs beyond training data augmentation.

Hi Moto,
I think this functionality is useful. There are already some papers using
codec augmentation successfully (e.g, https://arxiv.org/pdf/2005.07143.pdf).
Of course, more diversity in terms of different codecs  would be a plus.
Personally, I like the idea of having this functionality
"on-the-fly" without  the need of saving audio files on disk.
On Fri, 1 Jan 2021 at 14:15, Piotr Żelasko<EMAIL_ADDRESS>wrote:

I agree with Dan’s point that mobile phone codecs would probably be the
most useful. I also know of some cases where the companies stored telephone
recordings in mp3...
As a side note, mp3 has been used as a defense method against adversarial
attacks (not necessarily a very strong one though). The point is there
could be other applications for codecs beyond training data augmentation.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/pytorch/audio/issues/1146#issuecomment-753370101, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AEA2ZVRQOLK34BPS2ZTO5MDSXYNNTANCNFSM4VP7HZMA
.

Hi Moto,
I think this functionality is useful. There are already some papers using
codec augmentation successfully (e.g, https://arxiv.org/pdf/2005.07143.pdf).
Of course, more diversity in terms of different codecs  would be a plus.
Personally, I like the idea of having this functionality
"on-the-fly" without  the need of saving audio files on disk.
On Fri, 1 Jan 2021 at 14:15, Piotr Żelasko<EMAIL_ADDRESS>wrote:

I agree with Dan’s point that mobile phone codecs would probably be the
most useful. I also know of some cases where the companies stored telephone
recordings in mp3...
As a side note, mp3 has been used as a defense method against adversarial
attacks (not necessarily a very strong one though). The point is there
could be other applications for codecs beyond training data augmentation.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/pytorch/audio/issues/1146#issuecomment-753370101, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AEA2ZVRQOLK34BPS2ZTO5MDSXYNNTANCNFSM4VP7HZMA
.

Thanks for your comments.
In the past, I used https://github.com/idiap/acoustic-simulator for training telephony model with clean dataset. It worked great. The codecs used there [list] include telephone codecs from ITU, which is available at https://github.com/openitu/STL. We might be able to add that as additional codecs.
The next major codecs I was thinking to add AAC, and maybe binding ffmpeg. That can cover https://arxiv.org/abs/2005.07143.
If oyu know there is something needs attention when applying codecs, let me know, I will proceed with API design.

Thanks for your comments.
In the past, I used https://github.com/idiap/acoustic-simulator for training telephony model with clean dataset. It worked great. The codecs used there [list] include telephone codecs from ITU, which is available at https://github.com/openitu/STL. We might be able to add that as additional codecs.
The next major codecs I was thinking to add AAC, and maybe binding ffmpeg. That can cover https://arxiv.org/abs/2005.07143.
If oyu know there is something needs attention when applying codecs, let me know, I will proceed with API design.

Sorry for my late response.
I have not tried such techniques by myself, but it should be a very practical technique.
I'm looking forward to this implementation!
My colleagues also told me that the opus compression seems to have very high compression, and used in https://openslr.org/94/

Sorry for my late response.
I have not tried such techniques by myself, but it should be a very practical technique.
I'm looking forward to this implementation!
My colleagues also told me that the opus compression seems to have very high compression, and used in https://openslr.org/94/

Note: According to https://en.wikipedia.org/wiki/FFmpeg, ffmpeg contains codecs from ITU-T, so binding ffmpeg like torchvision does will be the easiest in both legal and technical perspective.

Note: According to https://en.wikipedia.org/wiki/FFmpeg, ffmpeg contains codecs from ITU-T, so binding ffmpeg like torchvision does will be the easiest in both legal and technical perspective.

@mravanelli @sw005320 @pzelasko @faroit @mpariente @danpovey
Dear all,
I read some previous comments and your discussion and I think, my project SpecAugment vs CodecAugement can be useful to you. I am working on similar research, to decide if we can use audio compression as a data augmentation or not. I have used OPUS audio codec as it is open source and royalty-free and checked at which bitrates (8,16,32,48,64, or 128 kbps) we can get the best output. My model is on speech emotion recognition but this methodology can be used on any audio-related problems.
You can check the pinned repo on my GitHub. Happy to help !!!

@mravanelli @sw005320 @pzelasko @faroit @mpariente @danpovey
Dear all,
I read some previous comments and your discussion and I think, my project SpecAugment vs CodecAugement can be useful to you. I am working on similar research, to decide if we can use audio compression as a data augmentation or not. I have used OPUS audio codec as it is open source and royalty-free and checked at which bitrates (8,16,32,48,64, or 128 kbps) we can get the best output. My model is on speech emotion recognition but this methodology can be used on any audio-related problems.
You can check the pinned repo on my GitHub. Happy to help !!!

Cool.  Would be nice to see effects on ASR accuracy if someone does the experiment.

Cool.  Would be nice to see effects on ASR accuracy if someone does the experiment.

Yes, we are also working on ASR with CodecAugment and it shows the better results too, but the research paper is not published yet and that project is not mine, so can't share many details. But in near future, there can be a publication.

Yes, we are also working on ASR with CodecAugment and it shows the better results too, but the research paper is not published yet and that project is not mine, so can't share many details. But in near future, there can be a publication.

From this conversation: https://groups.google.com/d/msgid/kaldi-help/0814d308-9150-475d-9163-398f54c6140en%40googlegroups.com
The decoder tools for Opus, which is often used nowadays in VoIP (e.g. WebRTC) transmission, have options for simulating packet loss as well as bit rates (https://opus-codec.org/docs/opus-tools/opusdec.html). You can pipe your audio through the opusenc/opusdec binaries in your wav.scp.

With Adaptive Multi-Rate (AMR) codecs, it's not as straightforward to simulate loss, but you can vary the mode (4.75-12.20 kbps for AMR-NB) over time. The reference implementation can take a "mode file" as input that lists the modes to use for each frame (https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=1387). Some link (QoS) adaptation schemes in use allow changes in mode every 2 frames (40ms).

From this conversation: https://groups.google.com/d/msgid/kaldi-help/0814d308-9150-475d-9163-398f54c6140en%40googlegroups.com
The decoder tools for Opus, which is often used nowadays in VoIP (e.g. WebRTC) transmission, have options for simulating packet loss as well as bit rates (https://opus-codec.org/docs/opus-tools/opusdec.html). You can pipe your audio through the opusenc/opusdec binaries in your wav.scp.

With Adaptive Multi-Rate (AMR) codecs, it's not as straightforward to simulate loss, but you can vary the mode (4.75-12.20 kbps for AMR-NB) over time. The reference implementation can take a "mode file" as input that lists the modes to use for each frame (https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=1387). Some link (QoS) adaptation schemes in use allow changes in mode every 2 frames (40ms).

Thanks for the input.
In the upcoming release, we are releasing apply_codec function as a beta feature.
Opus is not supported yet as the underlying libsox does not support writing opus format. Together with the packet loss simulation mentioned above, I will think what I can do about it.

Cool. Would be nice to see effects on ASR accuracy if someone does the experiment.

Please check.
N. Hailu, I. Siegert and A. Nürnberger, "Improving Automatic Speech Recognition Utilizing Audio-codecs for Data Augmentation," 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), Tampere, Finland, 2020, pp. 1-5, doi: 10.1109/MMSP48831.2020.9287127.
@danpovey

MM, you don't have a pdf link do you?
On Tue, Mar 2, 2021 at 7:51 PM Aditya<EMAIL_ADDRESS>wrote:

Cool. Would be nice to see effects on ASR accuracy if someone does the
experiment.
Please check.
N. Hailu, I. Siegert and A. Nürnberger, "Improving Automatic Speech
Recognition Utilizing Audio-codecs for Data Augmentation," 2020 IEEE 22nd
International Workshop on Multimedia Signal Processing (MMSP), Tampere,
Finland, 2020, pp. 1-5, doi: 10.1109/MMSP48831.2020.9287127.
@danpovey https://github.com/danpovey
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/pytorch/audio/issues/1146#issuecomment-788853201, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AAZFLO6X2SIMVQDHIMPDI6DTBTGMBANCNFSM4VP7HZMA
.

Hmm..it's published on IEEE.
https://ieeexplore.ieee.org/abstract/document/9287127
Here is the link. I have university access of IEEE.


Automated tests

This allows to run automated tests via Travis CI. https://docs.travis-ci.com

Hi Vladimir, the repository is marked active on Travis. You can merge the pull request of markseu if you like. If you need anything more, please let me know.
Cheers Geert.

Thanks, Geert!
And thank you @markseu for the push that was needed to actually run the tests 😄


Feature Suggestion: Support Additional Data Annotation Attributes

Would you consider adding support for the full set of annotation attributes supported by JSON.Net Schema?
From the page:

[x] RequiredAttribute | Property will be required.
[x] MinLengthAttribute | minLength of a string or the minItems in an array.
[x] MaxLengthAttribute | maxLength of a string or the maxItems in an array.
[x] RegularExpressionAttribute | String pattern.
[x] RangeAttribute | Number minimum and maximum.
[x] StringLengthAttribute | String minLength and maxLength. https://github.com/NJsonSchema/NJsonSchema/commit/fe0b60ae23c7fc1f242eb7d2a4fac889b85b1ffb
[ ] EnumDataTypeAttribute | Enum type used to generate enum values.
[x] DataTypeAttribute | String format depending on the DataType value. Supports Url, Date, Time, DateTime, EmailAddress, PhoneNumber (sets the JSON Schema "format").
[ ] UrlAttribute | String uri format (sets the JSON Schema "format").
[ ] PhoneAttribute | String phone format (sets the JSON Schema "format").
[ ] EmailAddressAttribute | String email format (sets the JSON Schema "format").

Definition of Done:

Implemented attribute handling
Added unit test
Updated wiki

Thanks for listing all of available attributes. We should implement these in the JSON Schema generator...

Awesome. I'm happy to have a crack at this if it's not too difficult.

Yes, I think most attributes should be easy to implement...

Implemented StringLengthAttribute in commit https://github.com/NJsonSchema/NJsonSchema/commit/fe0b60ae23c7fc1f242eb7d2a4fac889b85b1ffb

Will it be possible to support custom annotations that Inherit from the data annotation classes?

Yes, this should work:

No, I think currently it does not work because it looks for the exact attribute name not if an attribute inherits from it:
    private Attribute TryGetAttribute(IEnumerable<Attribute> attributes, string attributeType)
    {
        return attributes.FirstOrDefault(a => a.GetType().FullName == attributeType);
    }

shouldn't changing the method to:
private Attribute TryGetAttribute(IEnumerable<Attribute> attributes, string attributeType)
{
       return attributes.FirstOrDefault(a => Type.GetType(attributeType, false, true).IsInstanceOfType(a));
}

do the trick?
This way by checking for the DataType attribute, you get all it's subclasses for free (Email, Phone, etc...)
This should also allow for custom sublcassing for validation.

We can use this: https://github.com/NSwag/NSwag/blob/master/src/NSwag.CodeGeneration/Infrastructure/ReflectionExtensions.cs
Can you open a new issue for this feature (instead of discussing it here)?

With https://github.com/NJsonSchema/NJsonSchema/issues/189 phone and email should be handled too.. we should add unit tests for them

Hey! Is this supposed to be implemented? I see the tests, but codegeneration from NSwag doesn't really add the EmailAddressAttribute. Where to look? What to fix? How can I help? :)

Is there a chance to also include CustomValidation support?


Remove Intel copyright from sourcecode

All source code has Intel copyright, we need to remove that and use the recommendation by LF AI & Data.

Hi @arun-gupta, Thanks for reporting the issue. WIP to check with legal about the license change and the potential impact. Btw, could you please point to the recommended license by LF AI & Data? I'd like to share with legal team also.

Checking and will get back to you

Contributors to the project retain their copyright in the code they contribute. For new contributions, our communities will generally use a community-focused copyright notice such as: "Copyright contributors to the OPEA project", as an example. You can see additional examples and read more on this here: https://www.linuxfoundation.org/blog/blog/copyright-notices-in-open-source-software-projects.
Existing company-specific contribution notices can stay as is, or, for simplicity given that those files may be patched down the road by future contributors, the copyright holder (and only the copyright holder) could transition to the general "Copyright contributors to the OPEA project". Please reach out with any questions. Thank you.

confirmed and closed. thanks


Invalid relative path in compiled output when referencing type from composite project

Repro repository: https://github.com/aquilae/typescript-rtti-relative-path-issue
Doing reflect<T>() where T is imported from a referenced composite project emits incorrect relative path to T source from importing module:
/* folder structure:
- packages // src dir
 - export
 - import
- .typescript // out dir
 - packages
  - export
  - import
*/

// Importing.ts
import { reflect } from 'typescript-rtti'
import type Exported from '../export/Exported'

reflect<Exported>()

// Importing.js
{ LΦ: function (t) { return require("../../.typescript/packages/export/Exported")["default"]; } }
//                                        ^ we're already in .typescript folder here
...

From what little investigation I could do, tsc treats composite projects as external modules, and the source file of symbol for Exported is .d.ts file from the export project out dir, not the source. Exported.ts.
That confuses RTTI which seemingly treats everything not under node_modules as "internal" files that don't move relative to each other.

Thanks for the detailed testcase! Definitely looks like a bug. I've incorporated this into our corpus testing until we can get this fixed.


Update semver.sh script when publishing stable version

https://github.com/lmc-eu/spirit-design-system/pull/34/files#r722216678
Uncommnent condition for BREAKING CHANGES

The script was removed in favor of conventional changelog.


Multiple react-s3-uploaders on a page don't call their own uploadFile function

Hey there, been using react-s3-uploader for a little while in a project. I just went to put multiple uploaders on a page, and ran into this issue.
No matter which uploader the user selects a file with, the uploadFile function of the first uploader is always called when the upload starts. That means that my preprocess, onProgress, etc. functions from that first uploader get called for all file uploads on the page, and my handler functions for the other uploaders never get called.
I'm checking with uploadFile function is being called by setting a breakpoint in it, and then checking this.props in the console. I've attached a unique data field to each uploader.
Any idea what is going on & can anyone else reproduce this?

Hi @tbohlen,  I haven't seen this issue before unfortunately, and scanning the code, I can't see any reason why this would be the case.  If you can put together a test case that reproduces, I'd be happy to see if I can spot what's going on.
Best, Sean

yeah, I couldn't see anything in the code that could cause this either...I haven't had a chance to go back and make a small repro case, but will post here if/when I do. For now, I've worked around it by storing some extra state outside the component.
Thanks for the response Sean.


Recent issue with levels/wall height module

After a recent update I noticed all lights are going through walls if they are configured with a height in the levels module. Using "Find the Culprit" I tracked the issue to this module. If disabled everything behaves as expected.
To replicate in a new world,

Enable Better Roofs, Levels, libWrapper, Light/Sound Mask, Wall Height.
Draw a light and a wall right next to it so it can cast a shadow
Move the light around the wall to confirm the shadow is cast correctly
Add a height of 0 to 9 to both the light and wall
Attempting to move or update the light after this will make the light ignore the wall as if it wasn't there
Disabling Light/Sound Mask and attempting this again should solve the issue and the wall will always cast a shadow correctly.

I'm unsure if this is necessarily something wrong on your end but it was working fine last week. So it must have been a recent update.
Thanks for your time.

Wall Height adds t and b (top and bottom range) to origin, but Light Mask overrides origin:
https://github.com/caewok/fvtt-light-mask/blob/723c5e2c66d1235c29056558b7ef94928041cb51/scripts/ClockwiseSweep/LightMaskClockwisePolygonSweep.js#L129

Thanks for the tip about overwriting origin! I believe v0.3.1 addresses this issue, but please re-open if the problem persists.


[Bug]: Uncentered buttons on ratings page (mobile view)

Contact Details
<EMAIL_ADDRESS>What happened?

The connect button is not center aligned.
Text has inconsistent left and right margins.

What browsers are you seeing the problem on?
Chrome
Relevant log output
No response
Are you interested in contributing?

[X] I'd like to work on this issue

Code of Conduct

[X] I have used the search function to check if an issue already exists
[X] I agree to follow this project's Code of Conduct

Which program are you contributing in?
gssoc

@pranshugupta54 can you please add gssoc and level labels to the PR


libcurl.Library does not support field access

Timely lib Matt! Trying to write some code based on libcurl and gave this a shot, but get the following error with both zig 0.9 and 0.10.
% zig build
./build.zig:10:8: error: type '@typeInfo(@typeInfo(@TypeOf<EMAIL_ADDRESS>does not support field access
    lib.link(exe, .{ .import_name = "curl" });
       ^

I'm using it in a project like:
% mkdir libcurl-debug && cd libcurl-debug
% zig init-exe
% git init
% git submodule add https://github.com/mattnite/zig-libcurl lib/zig-libcurl
% head -11 build.zig
const std = @import("std");
const libcurl = @import("lib/zig-libcurl/libcurl.zig");

pub fn build(b: *std.build.Builder) void {
    const target = b.standardTargetOptions(.{});
    const mode = b.standardReleaseOptions();
    const lib = libcurl.create(b, target, mode);

    const exe = b.addExecutable("libcurl-debug", "src/main.zig");
    lib.link(exe, .{ .import_name = "curl" });
    exe.setTarget(target);
% cat src/main.zig
const std = @import("std");
const c = @cImport({
    @cInclude("curl/curl.h");
});

pub fn main() anyerror!void {
    std.log.info("All your codebase are belong to us.", .{});
}

test "basic test" {
    try std.testing.expectEqual(10, 3 + 7);
}

haha awesome, unfortunately zig's error messages aren't there yet and what's going on here is a missing try since libcurl.create() can fail:
    const lib = try libcurl.create(b, target, mode);

this also means that you'll need to add a ! to the build function return type:
pub fn build(b: *std.build.Builder) !void {

It might be odd to just add an error union to a public function willy nilly, but it's an undocumented feature of build.zig. Here is a comptime switch checking whether build() it returns an error or not: https://github.com/ziglang/zig/blob/5087ec6f41ba928e14596e00822dc117aeb90a12/lib/std/special/build_runner.zig#L219

oh also wanted to mention that you're going to need to link libcurl's dependencies as well, I have them "packaged" as well (they don't return errors):

zig-zlib
zig-mbedtls
zig-libssh2

and you can see how to configure them the build.zig of this project:
    const z = zlib.create(b, target, mode);
    const tls = mbedtls.create(b, target, mode);
    const ssh2 = libssh2.create(b, target, mode);
    tls.link(ssh2.step);

    const curl = try libcurl.create(b, target, mode);
    ssh2.link(curl.step);
    tls.link(curl.step);
    z.link(curl.step, .{});
    curl.step.install();

    // even when static libraries are "linked" to another, the final executable still needs to explicitly link to each dependency:
    const tests = b.addTest("src/main.zig");
    tests.setBuildMode(mode);
    tests.setTarget(target);
    curl.link(tests, .{});
    z.link(tests, .{});
    tls.link(tests);
    ssh2.link(tests);

The UX isn't the greatest since you have to manually hook these up yourself but they're the bare minimum build libraries and the plan is to come up with a proper framework to package C/C++ libraries. Upside is that once you've got these hooked up to your application, it crosscompiles quite well.

Thanks! That got me further, but I'm still getting some linking errors from missing symbols when I actually try to use the code.
I'm trying to use libcurl to parse a URL like in this example:
const std = @import("std");
const curl = @cImport({
    @cInclude("curl/curl.h");
});

pub fn main() anyerror!void {
    const url = "http://example.com/path/index.html";
    const h = curl.curl_url();
    std.log.debug("{any}", .{h});

    const uc = curl.curl_url_set(h, curl.CURLUPART_URL, url, 0);
    std.log.debug("{any}", .{uc});
}

But I get:
% zig build
error(link): undefined reference to symbol '_libssh2_sftp_rmdir_ex'
error(link):   first referenced in '/tmp/libcurl-debug/zig-cache/o/839d6667a73e0813c13263cd13a99184/libcurl.a(/tmp/libcurl-debug/zig-cache/o/aefbda8d02202c5cb2c1c18b7c38474b/libssh2.o)'
error(link): undefined reference to symbol '_libssh2_userauth_list'
error(link):   first referenced in '/tmp/libcurl-debug/zig-cache/o/839d6667a73e0813c13263cd13a99184/libcurl.a(/tmp/libcurl-debug/zig-cache/o/aefbda8d02202c5cb2c1c18b7c38474b/libssh2.o)'
error(link): undefined reference to symbol '_libssh2_userauth_publickey_fromfile_ex'
error(link):   first referenced in '/tmp/libcurl-debug/zig-cache/o/839d6667a73e0813c13263cd13a99184/libcurl.a(/tmp/libcurl-debug/zig-cache/o/aefbda8d02202c5cb2c1c18b7c38474b/libssh2.o)'
error(link): undefined reference to symbol '_libssh2_version'
error(link):   first referenced in '/tmp/libcurl-debug/zig-cache/o/839d6667a73e0813c13263cd13a99184/libcurl.a(/tmp/libcurl-debug/zig-cache/o/aefbda8d02202c5cb2c1c18b7c38474b/libssh2.o)'
error(link): undefined reference to symbol '_libssh2_session_block_directions'
error(link):   first referenced in '/tmp/libcurl-debug/zig-cache/o/839d6667a73e0813c13263cd13a99184/libcurl.a(/tmp/libcurl-debug/zig-cache/o/aefbda8d02202c5cb2c1c18b7c38474b/libssh2.o)'
error(link): undefined reference to symbol '_libssh2_session_disconnect_ex'
error(link):   first referenced in '/tmp/libcurl-debug/zig-cache/o/839d6667a73e0813c13263cd13a99184/libcurl.a(/tmp/libcurl-debug/zig-cache/o/aefbda8d02202c5cb2c1c18b7c38474b/libssh2.o)'
[... many more ...]

could you share your build.zig file and information on your system? I'm hoping it's a simple linking error and not an issue with my build scripts

Getting similar errors on both macOS arm64 and Linux x86.
% uname -sr
Linux 5.15.7-200.fc35.x86_64

I set up a project where it reproduces. Probably not doing enough ..link(). 😄

ah I see, yeah more link() is needed lol:
    const exe = b.addExecutable("main", "src/main.zig");
    _libcurl.link(exe, .{ .import_name = "curl" });
    exe.setTarget(target);
    exe.setBuildMode(mode);
    exe.install();

    const tests = b.addTest("src/main.zig");
    tests.setBuildMode(mode);
    tests.setTarget(target);
    _libcurl.link(tests, .{});
    _zlib.link(tests, .{});
    _mbedtls.link(tests);
    _libssh2.link(tests);

so you need to add these lines, I know this sucks rn, but I'm currently figuring out a mechanism for correctly handling transitive link dependencies:
    _zlib.link(exe, .{});
    _mbedtls.link(exe);
    _libssh2.link(exe);

Yep, that worked Matt, thanks! Here's the version that works.


Nexus

Give it a few months...

https://nexus.js.org/
https://github.com/prisma/nexus-prisma

Also consider https://github.com/prisma/yoga2

Go for it! https://github.com/prisma/prisma/issues/3774#issuecomment-478886351


Actions: Private networking for GitHub-hosted macOS runners

Summary
GitHub is thrilled to announce the availability of private networking for hosted macOS runners. This feature allows users to assign a set of static IPs to a runner or runner group, and also provides the option to use Azure private networking for macOS runners. By executing workflows behind the protection of the Azure Virtual Network, customers can ensure additional network security for workflows that require access to private resources within their network. This will be particularly useful for developers who have enabled IP allow lists, as they can now assign a specific set of static IPs to macOS runners.
Intended Outcome
GitHub now offers private networking capabilities for hosted macOS runners, which enables users to securely access private resources within their on-prem or cloud-based locations, such as databases, artifactory, storage accounts, or APIs. Developers can enforce network security policies and outbound access rules on the runners, which can help to reduce data exfiltration risks. Additionally, developers can isolate their build traffic from the public internet and route it through their existing private network connections (such as VPN or ExpressRoute).
How will it work?
The process of assigning static IPs or setting up Azure private networking for macOS runners is the same as it is for Ubuntu and Windows runners. For more information, please refer to our documentation.

Azure Private Networking
Assigning static IPs

🚢 This has shipped: https://github.blog/changelog/2024-05-20-actions-upcoming-changes-to-github-hosted-macos-runners/

Re-opening - as this has not yet shipped.

This issue is being closed as outdated. For more information, please check out this Discussion post. Stay tuned for new additions to our refreshed public roadmap!

We wanted to provide more details on why we removed this from the roadmap. We continue to plan to bring private networking to macOS runners, but we have removed this from our roadmap for now until we have more certainty on our timeline.
If you’re interested in this feature, please share your feedback in the GitHub community so we can track interest and consider it in the future.


Possibly found the reason why networks are getting blocked.

I've been researching the blog of snapchat for a bit and I noticed that recently they have updated some guidelines.
Here's one of them:
Device Information: We collect information about your device, including the hardware model, operating system and version, unique device identifiers (including MAC address and IMEI), browser type and language, mobile device phone number, and mobile network information. We also collect certain device information that will help us diagnose problems in the (hopefully rare) event you experience any crash or other problem while using our Services. So, for example, if we detect a crash or other problematic event, we may collect the list of apps on your device and other information about your device’s performance at the time of the event for troubleshooting purposes.
Now lets take a look at why and with what message snapchat blocks a network.
"Suspicious activity"
Meaning it's something inside the code that triggers something repeatedly.
Triggering once? fine
Twice? fine
An established amount by snapchat times? Fucked.
Now lets look at this line of text in the article:
unique device identifiers (including MAC address and IMEI)
What I think is that snapchat registers not only a lot of people logging in from the same network (which should in theory be fine, think about public wifi etc)
But they also detect EVERYONE logging in from the same device!
-Either due to the above stated IMEI and MAC (do these even exist with a web server?, if not a lack of them might flag it)
-The exact same user agent that everyone from your network logs in with.
(see this line in the article:  including the hardware model, operating system and version,)
Is anyone here able to test this theory out with me?
I think this will have a big chance to solve the network blocking.

I'd be more than happy to help test this out but I'm not super skilled in the technical department.
Would you like me to test this out by changing around
CURLOPT_USERAGENT => 'Snapchat/<IP_ADDRESS> (Nexus 5; Android 21; gzip)',
?

Previously ran the API on VPS server - Worked one month and the IP address has been blocked,
and then ran the API on localhost, worked a few days and again the IP has been blocked.
I updated the data CURL
CURLOPT_HTTPHEADER => array(
	'Accept-Language: en-GB;q=1, en;q=0.9',
	'Accept-Locale: en'
),

and
CURLOPT_USERAGENT => 'Snapchat/8.1.1 (Nexus 5; Android 21; gzip)',

and again blocked.
Now I do not know what to do to fix it.
Maybe this problem is because I don't use authtoken to again login but with this is next problem beacause AuthToken does not work.

If the network was already blocked, then ofcourse changing the headers and useragent would not help, you have to wait until the block is lifted and keep randomizing it in the hope it won't get blocked again.
It's not something we check, it's something server side checks.

Wouldn't randomizing the device each request be more suspicious than
keeping the same device between requests? We need to make it so the library
as a whole doesn't utilize the same device headers.
If the network was already blocked, then ofcourse changing the headers and
useragent would not help, you have to wait until the block is lifted and
keep randomizing it in the hope it won't get blocked again.
It's not something we check, it's something server side checks.
—
Reply to this email directly or view it on GitHub
https://github.com/JorgenPhi/php-snapchat/issues/82#issuecomment-69576649.

I should have explained myself better, I am looking from a standpoint where multiple people are using the app/code from the same network / ip.
You are right, when it's only you using it, try a different header than the one in the libary.
But keep them the same in between requests.
Focusing on apps that multiple people use, I think the server side of snapchat detects a X amount of users logging in from one device.
I remember a while back when I ran some tests, before snapchat became this strict, that I would  have problems performing functions from multiple accounts at the same time.
Every single account in a row was fine, but at the same time usually got the account locked and/or the network blocked.

@Snowlav I understand what you're saying. But is there a way to use a proxy with this so that I can bypass the block? Because it's been 4 days now.

Yeah find a proxy and pass it along with the cURL requests.
On Jan 12, 2015 10:06 PM, "Dgameman1"<EMAIL_ADDRESS>wrote:

@Snowlav https://github.com/Snowlav I understand what you're saying.
But is there a way to use a proxy with this so that I can bypass the block?
Because it's been 4 days now.
—
Reply to this email directly or view it on GitHub
https://github.com/JorgenPhi/php-snapchat/issues/82#issuecomment-69692708
.

public static $CURL_OPTIONS = array(
CURLOPT_CONNECTTIMEOUT => 5,
CURLOPT_RETURNTRANSFER => TRUE,
CURLOPT_TIMEOUT => 10,
CURLOPT_FOLLOWLOCATION => true,
CURLOPT_USERAGENT => 'Snapchat/8.1.1 Beta (Nexus 4; Android 17; gzip)',
);
So I would add
CURLOPT_PROXY => PROXY:PORT,right?

We can try add to library list User Agents from Android devices (10 or more) and iOS and when somebody trying sign in we can randomizing useragent for this username and save for example in sqlite.
But this problem isn't my because I only use 2 accounts for accepting invite to friends, receive snaps and send Snap with authentication code to manage content on website. In my position i think problem is with receive many Snaps in one moment but I'm not sure.
@Dgameman1 for proxy port u mast use
CURLOPT_PROXY => PROXYIP,
CURLOPT_PROXYPORT => PORT

@anchorit3 good thinking about the user agent, but what about they IMEI and MAC address they gather?

@Snowlav I think Snapchat does not have access to IMEI and MAC device from received data but it's possible that I'm wrong.

Snapchat doesn't send the device MAC or IMEI at any point, from what I have seen from looking through all the requests.

Hmm I guess I got thrown off by their statement saying they did.
It made sense given the fact I always face this problem once more than 3 accounts are active on the platform / doing the same thing.

@anchorit3 Thank you. But now the issue is I get an error saying...
array(3) {
["error"]=>
int(1)
["message"]=>
string(22) "API Connection failed."
["result"]=>
string(44) "Connection timed out after 5005 milliseconds"
}
and I even went ahead and changed the timeout CURLOPT_TIMEOUT => 200,

@Dgameman1 I add CURLOPT_PROXYTYPE  and checked this on my localhost and this worked
$proxyip = '<IP_ADDRESS>'; // proxy IP
$proxyport = 8080; // proxy PORT
(...)
CURLOPT_PROXYPORT => $proxyport,
CURLOPT_PROXY, $proxyip,
CURLOPT_PROXYTYPE => 'HTTP',

I use one proxy server from this list:
http://proxylist.hidemyass.com/

"If you believe you received the notification in error, it may be because you are using an old version of Snapchat. Please make sure you have the most recent version of the app downloaded.
If you have stopped using third-party applications, changed your password already, and updated to the most recent version of Snapchat, there is no need to contact us. However, if you are still having trouble with your account, please let us know below." from https://support.snapchat.com/co/third-party-cf


Hockey Tracking Doesn't Work

Can't find _mh_execute_header symbol. 64-bit issue?

Hockey's updated their SDK apparently, because I deployed today and this wasn't a problem. Closing.


Stream training errors

What is wrong?
Attempting to use the stream training (net.createTrainStream followed by flooding the stream) throws errors as it attempts to access non-existent methods.  I attempted to map the similarly named _methods (_formatData, _initialize, etc), but that led to more errors.
Where does it happen?
Running this under node.js (v 10.5.0, but doesn't appear to be version specific) on my Mac I get errors like this:
node_modules/brain.js/dist/train-stream.js:142
        var data = this.neuralNetwork.formatData(this.firstDatum);
                                      ^

TypeError: this.neuralNetwork.formatData is not a function

How do we replicate the issue?
Run the sample: examples/cli/stream-example.js
How important is this (1-5)?
4
Expected behavior (i.e. solution)
Sample should run without error.
Other Comments
If streaming can't be easily fixed, are there alternative ways of training in small batches?  I'm trying to train with a very large data set that doesn't fit into memory all at once.

AFAIK stream training is not supported in simple recurrent network (RNN). Are you using that one?
@robertleeplummerjr please confirm

No I encountered this using the brain.NeuralNetwork class.  Same as the sample here that fails.

Now working, please reopen if you find any issues.  The api did change a little. New example here.


Upgrade crate version to 0.2.109

r? @Amanieu

I'll push out a release tomorrow after the bors queue is flushed.

@bors r+

:pushpin: Commit 9db545f59ddf729fb25c81ea045f279ff70c2b11 has been approved by Amanieu

:hourglass: Testing commit 9db545f59ddf729fb25c81ea045f279ff70c2b11 with merge 803eba6462db71fd6b26bc1c4735df051097b2d8...

:broken_heart: Test failed - checks-actions

@bors retry

:hourglass: Testing commit 9db545f59ddf729fb25c81ea045f279ff70c2b11 with merge 7f8d24422390eeafe1eb905f9704e139d20ce4d9...

:sunny: Test successful - checks-actions, checks-cirrus-freebsd-11, checks-cirrus-freebsd-12, checks-cirrus-freebsd-13
Approved by: Amanieu
Pushing 7f8d24422390eeafe1eb905f9704e139d20ce4d9 to master...